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AN   ANALYSIS   OF  CERTAIN   PSYCHOLOGICAL  TESTS   USED  FOR 
THE  EVALUATION  OF  BRAIN  INJURY* 

I.  Introduction 


ONE  rvi'E  oi  battle  casualty  which  has 
had  increasing  attention  in  both 
medicine  and  psychology  is  brain  in- 
jury. The  problems  of  diagnosis,  symp- 
tomatology (mental  and  physical),  re-edu- 
cation, and  rehabilitation  are  of  the 
utmost  importance.  Each  of  these  prob- 
lems, to  some  extent,  falls  into  the  field 
of  clinical  psychology.  Through  the 
proper  use  of  existing  measures  the  clini- 
cal psychologist  can  aid  in:  (i)  Differ- 
ential diagnoses;  (2)  The  estimation  of 
previous  and  present  levels  of  capability; 
(3)  The  determination  of  personality 
dysfunction;* (4)  The  detection  of  specific 
losses  in  mental  efficiency;  and  (5)  The 
development  of  a  program  for  re-educa- 
tion and  rehabilitation.  This  does  not 
mean  that  all  of  the  psychological  ques- 
tions regarding  brain  injury  have  been 
answered.  Research  is  particularly  needed 
in  explaining  the  biological-psychological 
relationships  of  behavior  manifested  by 
brain    injured   persons. 

The  collation  of  data  obtained  through 
the  analysis  of  different  psychological 
measures  administered  to  various  types 
of  mental  entities  fiuthers  test  develop- 
ment. The  new  approaches  thus  provided 
make  it  possible  to  assemble  a  more  com- 
plete and  accurate  clinical  picture.  It 
is  only  through  the  constant  application 
of  the  experimental  technique  that  clini- 
cal psychology  can  keep  abreast  of  its 
rapidly  expanding  scope. 

Clinical  psychology  has  advanced  be- 
yond   the    state    of    mere    quantitative 

•  We  are  indebted  to  Captain  J.  A.  Aita,  M.C., 
AUS,  for  neurological  evaluation  of  brain  in- 
jured cases  used  in  this  paper,  and  to  Mr. 
Ralph  M.  Reitan  for  contributing  those  sections 
of  the  paper  dealing  with  the  Rorschach  findings. 


measurement  of  specifically  dcHncd  traits 
and  abilities.  The  considerations  neces- 
sary in  the  field  are  rapidly  approaching 
the  goal  of  understanding  the  interrela- 
tionships of  human  characteristics.  Re- 
cent studies  by  Rapaport  (23)  indicate 
that  the  trend  in  psychological  investiga- 
tion is  toward  the  evaluation  of  individ- 
ual test  results  as  a  part  of  a  behavioral 
picture.  For  example,  the  data  obtained 
from  the  Wechsler-Bellevue  (32)  is  no 
longer  considered  a  mere  indicator  of 
intellectual  level  alone,  but  is  also  of 
assistance  in  the  detection  of  specific 
personality  maladjustments  and  the  pres- 
ence of  possible  organic  cerebral  altera- 
tion. The  use  of  projective  techniques 
such  as  the  Rorschach  (25)  and  the  The- 
matic Apperception  Test  (21)  are  further- 
ing the  clinical  psychologist's  apprecia- 
tion of  the  value  in  understandim^  the  in- 
dividual  as  an  integrated  whole.  With  this 
concept  as  a  frame  of  reference,  perhaps 
something  can  be  gained  by  re-examining 
the  previously  mentioned  uses  of  clinical 
psychology  insofar  as  the  brain  injured 
individual  is  concerned. 

The  estimation  of  the  level  of  capa- 
bility and  the  determination  of  specific 
fimctional  losses  will  be  discussed  to- 
gether. As  Goldstein  has  discussed  in 
detail,  the  IQ  is  often  misleading  and 
is  of  limited  value  in  cases  of  brain  in- 
jury (8).  A  full  scale  score  obtained  from 
such  measures  as  the  Wechsler  Mental 
Abilities  Scale  (Form  B)  (or  M.\S)  (33) 
or  the  Wechsler-Bellevue  (32),  however, 
does  provide  a  good  estimation  of  an 
individual's  position  in  relation  to  the 
general  population.  It  serves  as  a  base 
line   against  which   impairment  can  be 
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nicasiuttl.  ami  nho  as  a  roiii^h  tsiimatc 
in  e\aluatini;  the  brain  injured  patient's 
general  capability  for  luture  job  place- 
ment. However,  the  IQ  has  all  of  the 
disadvantages  of  any  mean  as  it  gives 
very  little  indication  of  the  actual  status 
of  the  components  which  make  up  the 
average.  The  assumption  that  all  intel- 
lectual functions  measured  contribute 
equally  to  the  total  result  is  a  hypotheti- 
cal consideration.  Actually,  as  every  cli- 

Table  I 

A  partial  Wechsler-Bellevue  record  of  a 
severely  brain  damaged  patient 


Tests 

Weighted 
Score 

Information 

8 

Comprehension 

9 

Arithmetic 

' 

I 

Digit  Span 

9 

Similarities 

4 

Verbal  Score 

31 

Picture  Completion 

8 

Picture  Arrangement 

3 

Object  Assembly 

I 

Block  Design 

I 

Digit  Symbol 

2 

Performance  Score 

IS 

Total  Score 

46 

Verbal  Score             31- 

-IQ- 

-83 

Performance  Score  15- 

-IQ- 

-66 

Full  Scale  Score       46- 

-IQ- 

-73 

nician  knows,  there  is  nearly  always  a 
degree  of  sub-test  scatter.  Thus  it  be- 
comes necessary  to  evaluate  the  IQ  in 
terms  of  the  sub-test,  especially  when 
dealing  with  brain  damaged  patients. 
A  partial  Wechsler-Bellevue  (32)  record 
of  a  brain  injured  patient  is  given  in 
Table  1.  On  the  basis  of  the  total  score 
the  assumption  may  be  made  that  the 
patient  was  operating  on  a  border-line 
defective  level.  Omitting  those  scores  that 
have  been  found  to  be  relatively  un- 
affected by  post-travmiatic  brain  injury 
(1),  it  is  apparent  that  the  obtained  IQ 
is  not  adequate  evaluation  of  the  pa- 
tient's  intelligence.   The   IQ  considered 


in  isolation  is  only  a  single  and  often 
luueliable  segmeiu  of  the  total  behav- 
ioral pattern. 

In  the  diagnosis  of  personality  dis- 
orders certain  clinical  tests  are  extremely 
helpfid.  In  many  cases  by  the  proper 
use  of  certain  of  them  it  is  not  only  pos- 
sible to  label  the  disorder  but,  through 
such  projective  techniques  as  the  The- 
matic Apperception  Test  (21),  the  cause 
may  be  indicated.  However,  in  deter- 
mining the  presence  of  brain  damage,  it 
is  extremely  doubtful  that  any  psycho- 
logical measure  will  approach  the  va- 
lidity of  the  pneumo-encephalogram, 
surgeon's  reports,  and  neurological  find- 
ings. The  most  important  consideration 
of  psychological  testing  is  not  to  give  a 
positive  or  negative  statement  as  to  the 
presence  of  cerebral  alteration.  The  pri- 
mary concern  of  the  psychologist  should 
be  to  discover  personality  or  behavioral 
changes  typical  of  brain  injury  and  deter- 
mine their  influence  upon  future  adjust- 
ments. Rather  than  to  attempt  a  diag- 
nosis of  the  presence  of  brain  injury, 
psychological  tests  should  attempt  to 
answer  questions  such  as:  (1)  Has  the 
injury  created  a  definite  loss  in  intel- 
lectual functioning?  (2)  What  specific 
abilities  have  been  retarded?  (3)  Has  the 
personality  structure  undergone  changes, 
either  of  a  temporary  or  a  permanent 
nature?  (4)  To  what  extent  are  education 
and  rehabilitation  possible?  (5)  Where 
will  the  patient  fit  into  the  social  struc- 
ture in  the  future?  It  is  the  opinion  of 
the  writer  that  too  much  emphasis  in 
clinical  psychology  has  been  placed  on 
the  diagnostic  aspect  and  too  little  on 
the  points  enumerated  above.  This  pos- 
sibly has  been  a  consequence  of  a  differ- 
ent scale  of  values  which  had  to  be 
adopted  during  the  war  period.  The 
press   of   psychological   casualties   of  all 
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types  increased  the  importance  of  correct 
classification.  This  is  a  trend  away  from 
the  concept  of  total  behavior,  and  a 
readjustment  of  attitude,  and  thinking 
should  occur  to  insure  the  continued 
advance  of  clinical  psychology. 

Although  re-education  and  rehabilita- 
tion are  not  topics  to  be  discussed  in  this 
paper,  they  are  of  vital  concern  to  the 
brain  injured  patient.  He  is  faced  with 
such  problems  as  the  ability  to  earn  an 
adecpiate  li\ing  wage  and  to  otherwise 
make  an  adequate  social  adjustment. 
Consequently  a  great  deal  of  worry  and 
anxiety  occurs  which,  if  left  unheeded, 
may  develop  into  a  definite  neurosis.  As 


a  preventative  measure  there  has  been 
instituted  a  program  of  occupational 
therapy  in  all  military  hospitals.  Keeping 
the  patient  occupied  is  sound  practice 
and  has  been  exceptionally  fruitful.  In 
conjunction  with  occupational  therapy, 
educational  reconditioning  classes  are 
conducted.  They  provide  instruction  in 
such  trades  as  radio,  mechanics,  carpen- 
try, etc.  and  use  the  facilities  of  the 
United  States  Armed  Forces  Institute. 
The  extent  to  which  these  programs  will 
succeed  for  the  individual  brain  injured 
patient  is  determined  to  a  large  degree 
by  the  recommendations  of  the  clinical 
psychologist. 


11.  What  Is  the  Brain  Injured  Patient  Ijre? 


IN  an  excellent  review  ot  the  literature, 
Klcbanoff  (17)  has  collated  a  vast 
amount  of  previously  published  data  in 
an  attempt  to  determine  the  psychologi- 
cal residuals  ol  brain  damage.  In  reading 
the  article  one  is  impressed  with  the 
fact  that  conclusions  have  been  drawn 
from  relatively  limited  samples  and  that 
questionable  tests  and  testing  techniques 
have  been  employed.  These  deficiencies 
are  clearly  indicated  in  his  concltisions: 
"It  is  felt  that  experimental  progress 
demands  the  satisfaction  of  two  methodo- 
logical considerations.  First  .  .  .  must 
involve  comparisons  between  .  .  .  organic 
brain  disorders  and  normal  persons. 
Second  .  .  .  specialized  test  development 
should  be  directed  toward  the  various 
spheres  of  possible  psychological  impair- 
ment"'. Certainly  these  aims  are  basic. 
However,  there  are  other  aspects  that 
shotdd  not  be  overlooked.  One  of  these 
is  the  source  of  the  injury.  The  brain 
injured  cases  to  be  considered  in  this 
paper  all  suffered  post-traumatic  injuries. 
In  a  recent  publication  an  exhaustive 
inquiry  has  been  made  into  this  type  of 
injiny.  Two  of  the  contributors,  Gurd- 
jian  and  AVebster  (10)  present  a  study 
of  a  variety  of  experimentally  produced 
head  injuries.  The  means  of  creating  the 
damage  roughly  corresponds  to  the  source 
of  most  of  the  injuries  received  by  the 
patients  to  be  considered  in  this  publi- 
cation. In  general  their  results  point  to 
the  difficulty  involved  in  determining 
whether  an  injury  is  of  a  focal  or  diffuse 
nature.  Of  the  patients  used  in  the  pres- 
ent study  who  were  known  to  have  defi- 
nite cerebral  injury,  only  12%  were  con- 
sidered to  be  purely  focal  by  the  neurolo- 
gist. The  others  were  classed  either  as 
focal-diffuse  or  diffuse.  Because  of  the 
nature  of  our  case  material  we  are  not 


in  a  position  to  attempt  a  correlation 
of  beha\'ioral  changes  with  injury  to  a 
specific  cortical  area.  It  is  our  opinion 
that  this  can  be  attempted  only  when 
dealing  with  pine  focal  surgical  lesions 
similar  to  those  reported  by  Freeman  and 
Watts  (7). 

Another  consideration  is  the  presence 
or  suspected  presence  of  personality  al- 
teration. If  such  changes  have  occurred, 
how  do  they  affect  the  psychological  test 
results?  It  is  very  likely  that  some  of  the 
indications  given  by  the  tests  may  be  due 
to  personality  dysfunction  precipitated 
by  the  injury  and  not  to  cerebral  damage. 
Experimentally  this  distinction  becomes 
important.  Again  it  will  not  be  possible 
to  give  any  conclusive  statements  in  this 
respect.  All  evidence  will  of  necessity  be 
indirect  or  comparative  as  our  case  rec- 
ords indicate  little  of  the  personality 
structure  or  adjustments  of  the  indi- 
vidual patients  before  the  injuries  oc- 
curred. The  study  of  Freeman  and  Watts 
(7)  is  one  of  the  few  that  has  been  ade- 
quately controlled  in  this  sense.  In  addi- 
tion their  cases  are  being  followed  up 
and  from  such  procedure  much  valtiable 
data  should  be  obtained. 

The  final  point  is  the  necessity  of 
comparing  the  test  results  of  the  brain 
injured  patient  with  results  from  groups 
of  patients  representing  all  other  types 
of  mental  disorders.  It  is  of  importance 
to  ascertain  whether  the  performance  of 
a  brain  damaged  patient  is  characteristic 
or  similar  to  that  obtained,  for  example, 
from  a  schizophrenic.  Only  by  means  of 
stich  a  technique  can  the  question  of  test 
validity  be  completely  settled. 

With  all  of  these  points  as  a  back- 
ground, it  is  our  purpose  to  consider  the 
post  traumatic  brain  injured  patient  from 
the  standpoint  of  intellect  and  affect. 
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A. INTELLECT 

It  is  difficult  to  estimate  pre-injury 
intellect  but  it  has  been  noted  that  cer- 
tain Wechsler-Bcllevue  and  MAS  items 
such  as  vocabulary  and  information  ap- 
pear to  remain  approximately  at  their 
previous  level  (i).  Using  these  items  as 
base  lines  and  comparing  the  results  of 
the    remaining   sub-tests    to    them    it    is 


shown  in  Table  2.  Slightly  more  than 
half  of  those  patients  who  had  suffered 
definite  injury  had  an  accompanying 
definite  intellectual  loss  according  to  our 
measurements.  Certainly  the  failure  of 
47%  of  the  patients  to  show  any  retarda- 
tion requires  explanation.  The  following 
variables,  any  one  of  which  might  ac- 
count for  the  above  results,  are  presented 


Table  2 

Intellectual  changes  following  post  traumatic  brain  injury 
as  indicated  by  the  MAS  and  Rorschach 


N 

Patients  Maintaining 
Previous  Level 

Patients 
Previous 

Below 
Level 

Previous  Level 

N 

% 

N 

% 

Above  average 
Average 
Below  Average 

13 
37 
10 

4 
20 

4 

31 
54 
40 

9 

17 

6 

69 
46 
60 

Total 

60 

28 

47 

32 

53 

possible  to  determine  roughly  tlie  extent 
of  intellectual  loss.  However,  this  tech- 
nique is  not  completely  valid.  Hinit  (15) 
lists  a  nimiber  of  methodological  criti- 
cisms and  Babcock  (5),  who  is  largely  re- 
sponsible for  this  method,  indicates  that 
vocabulary  suffers  when  the  deterioration 
is  severe.  In  order  to  obtain  as  accurate 
an  estimate  as  possible,  the  findings  from 
the  MAS  and  the  Rorschach  were  col- 
lated. This  method  curtailed  the  size  of 
the  sample  but  lent  credence  to  the  as- 
sumed pre-injury  mental  level.  As  an 
added  check  the  prior  AGCT  [.\rmy 
General  Classification  Test]  scores  were 
utilized  and.  although  not  intelligence 
measures,  they  were  of  value.  The 
Rorschac  h  data  is  of  exceptional  interest. 
When  combined  with  the  MAS  results 
it  is  not  only  possible  to  get  indications 
of  pre-and  post-injury  ability,  but  fm  thcr 
information  is  gained  regarding  the 
efficiency  with  which  this  ability  is  being 
utilized,  the  amount  of  drive,  and  the 
present  affective  picture.  The  results  are 


for  consideration:  (1)  Injuries  to  certain 
cortical  areas  may  not  be  followed  by 
losses  in  mental  ability:  (2)  The  severity 
and/or  type  of  trauma  and  the  severity 
and/or  type  of  consequent  injury  may 
have  been  responsible;  (3)  Previous  in- 
telligence level,  degree  of  education  or 
training,  and  cidtural  or  occupational 
background  may  have  masked  actually 
existing  changes;  (4)  Inaccmacies  in  esti- 
mating the  previous  intelligence  level 
may  have  occurred;  (5)  The  tests  them- 
selves may  have  been  too  restricted;  that 
is,  all  functions  and/or  areas  of  possible 
impairment  may  not  have  been  tapped; 

(6)  Malingering,  either  on  a. conscious  or 
unconscious  level  may  have  been  a  factor; 

(7)  Closely  allied  to  the  above  are  the 
possible  effects  on  the  test  rcsidts  of  affec- 
tive dysfunction;  and  (8)  Perhaps  the 
effects  of  the  injury  were  transitory  and 
improvement  before  the  patient  was 
tested  was  sufficient  to  erase  any  pre- 
viously existing  losses. 

As    has    already    been    indicated,    the 
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casi'    matt  rial    studictl    was   siu  h    that    it  indicated  by  the  data.    Tlic  lcchni(iuc  is 

-was  impossible  to  relate  specific  areas  ol  ci  iide  and  only  outstanding  generalized 

injury  to  changes  in   intellect  or  alFect.  retardation   can   be  readily  determined. 

The  sample  was  divided  into  the  broad  W'hether  (he  tests  used  were  adequate  is 

categories  ol  mild,  moderate,  and  severe  a  point  that  only  further  experimenta- 

injiuy.   The   results   of   this   breakdown  tion  can  definitely  establish.  Previous  in- 

are  shown  in  Table  3.    The  n'umbcr  of  vestigations  have  shown   them  to  be  of 

cases    in    the   sub-groups   are   much   too  some  value  (1). 

Table  3 

The  composition  of  the  groups  shown  in  Tabic  2  in  respect  to  mild, 

moderate  and  severe  brain  injuries 


Group 

Number 
Mild    Mod.    Severe 

Percent  of  Mild, 
Mod.,  Severe  Below 
Previous  Level 
Mild    Mod.  Severe 

Percent  of  Mild, 
Mod.,  Severe  Retain. 
Previous  Level 
Mild    Mod.  Severe 

Above  Average 
Average 
Below  Average 

760 
18           9         10 
3            6 

71          67           0 
39         22         80 
67         67           0 

29         33           0 
61          78         20 

33         33       100 

Total 

28          21          II 

5°         48         73 

50          52          27 

small  to  be  of  definite  significance.  Only 
in  the  total  group  with  severe  injuries 
did  any  relationship  exist  between  the 
extent  of  injury  and  reduction  in  intel- 
lect. These  results  do  not  include  con- 
sideration of  the  type  (focal,  focal-diffuse, 
diffuse)  or  area  of  the  injury.  The  com- 
position of  the  intelligence  groupings 
shown  in  Table  2,  in  respect  to  type, 
were  found  to  be  virtually  identical. 

The  training,  educational,  cultural, 
and  occupational  backgrounds,  although 
not  identical  were  not  too  dissimilar. 
However,  all  of  these  data  were  obtained 
directly  from  the  patients  wath  the  exist- 
ing possibility  of  inacciuate  statements. 
No  reason  for  falsification  of  this  in- 
formation by  the  subjects  was  apparent, 
however,  and  we  believe  that  the  data 
are  fairly  accurate. 

The  estimation  of  the  previous  intel- 
ligence level  leaves  much  to  be  desired. 
The  categories  into  which  the  patients 
were  divided  are  too  broad  to  allow  the 
detection  of  limited  changes.  Therefore, 
changes  may  be  present  which  are  not 


Malingering  is  difficult  to  prove.  How- 
ever, as  all  tests  were  given  individually, 
it  is  our  opinion  that  it  did  not  occur 
on  a  conscious  level.  The  possibility  was 
present  of  unconscious  evasion  as  a  result 
of  an  affective  maladjustment  but  if  it 
was  present  the  extent  was  impossible 
to  determine. 

A  series  of  articles  by  Ruesch  (26), 
Ruesch  and  Moore  (27),  and  Moore  and 
Ruesch  (20)  indicates  that  improvement 
in  mental  ability  does  occur  after  brain 
injury  particularly  during  the  first  few 
weeks.  Inasmuch  as  most  of  our  tests 
were  given  six  months  after  injury  this 
may  partially  account  for  the  high  per- 
centage of  subjects  whose  post-injtuy 
test  results  classified  them  in  the  same 
intelligence  range  as  their  estimated  pre- 
injury  intelligence. 

To  summate,  it  is  evident  that  there 
are  too  many  indeterminate  variables 
present  to  allow  any  conclusive  state- 
ments as  to  the  effects  of  brain  injury 
on  intelligence.  All  that  can  be  concluded 
is  that  some  of  the  patients  did  undergo 
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definite  measurable  mental  alteration. 
1  he  specific  functions  that  appear  to  be 
most  vulnerable  have  been  considered  in 
a  previous  study  (i). 

B.   AFFECT 

Affective  disorders  occurring  after  head 
injury  have  been  noted  and  described  by 
various  writers.  One  of  the  earliest  of 
these  was  .\doljjh  Meyer,  who  in  1904 
published  an  article  (19)  in  which  he 
described  the  sequelae  as  usually  con- 
sisting of  prolonged  periods  of  confusion 
with  hallucinatory  episodes  and  subse- 
quent recovery.  He  also  noted  that  other 
disturbances  were  frequently  present, 
such  as  impaired  retentive  memory,  re- 
tardation in  the  flow  of  thought,  extreme 
fatiguability,  irritability,  headaches,  and 
intolerance  to  alcohol.  Schilder  pub- 
lished a  significant  paper  in  1934  (28), 
in  which  he  discussed  disturbances  rang- 
ing from  temporary  confusion  following 
injury  to  a  catatonic  picture  which  was 
still  present  at  a  recheck  after  the  patient 
had  been  discharged  from  the  hospital. 

The  patients  that  we  have  studied  were 
admitted  to  the  hospital  usually  from 
three  to  six  months  following  injury, 
and  therefore  we  will  not  discuss  the 
temporary  confusion  and  disorientation 
immediately  following  recovery  of  con- 
sciousness. Rather,  we  will  be  concerned 
in  this  section  with  describing  affective 
disorders  which  either  develop  after  the 
injury  or  are  semi-permanent  in  nature. 

In  another  study  (2),  we  have  noted 
certain  disturbances  which  are  frequently 
present  among  persons  who  have  suffered 
head  injury.  Rorschach's  test  indicated 
that  anxiety,  depressive  tendencies  and 
hypochondriasis  were  often  present.  Oc- 
casionally records  gave  indications  which 
were  markedly  schizophrenic-like  in  na- 
ture. Emotional  control  was  not  signifi- 
cantly impaired,  according  to  the  Ror- 


schach findings,  except  among  patients 
with  severe  injuries. 

Schilder  has  found  substantially  the 
same  group  of  symptoms  (29),  consisting 
of  anxiety,  hysteria,  and  hypochondriasis 
among  the  frequent  post-injury  neurotic 
disturbances.  He  believes  that  these  dis- 
orders arise  largely  from  the  psychic 
\alue  of  the  head  and  from  neurotic 
tendencies  present  before  injury.  The 
"post-concussion  syndrome"  he  believes 
to  be  on  an  organic  basis,  although  an 
intricate  picture  soon  develops  because 
the  organically  based  disturbances  ac- 
centuate the  development  of  neurotic 
overlay. 

Study  of  our  patients  had  indicated 
that  the  "psychic  value"  of  the  head  is 
an  important  factor  in  the  development 
of  neurotic  disturbances.  As  an  example 
it  may  be  interesting  to  consider  one 
case  specifically.  This  patient  received 
a  moderately  severe,  penetrating,  left 
jiarietal  injury.  After  recovery  of  con- 
sciousness he  was  confused  and  dis- 
orientated. Gradually  he  recovered,  his 
ability  to  think  clearly  and  when  he  was 
admitted  to  our  hospital,  four  months 
later,  showed  no  signs  of  mental  con- 
fusion. He  had  developed  left  hemiplegia 
following  injury,  which  was  present  at 
this  time.  The  W-B  indicated  that  he  was 
of  low  superior  intelligence. 

After  several  discussions  with  one  of 
the  writers  the  patient  told  of  the  de- 
velopment of  anxiety  and  lack  of  pei- 
sonal  confidence  following  injury.  He 
was  aware  of  the  confusion  and  dis- 
orientation that  had  been  present  after 
the  injurv.  He  had  no  idea  how  the  head 
injury  would  affect  his  future  adjustment. 
Perhaps  due  to  prior  misinformation,  he 
suspected  that  his  behaxior  would  be 
peculiar  and  that  he  would  not  be  able 
to  recognize  these  peculiarities.  He  did 
not  place  much  confidence  in  what  the 
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doctors  told  him  concerning  his  psycho- 
logical adjusiuKius.  because  he  thought 
that  tlu'\  were  probably  Avithholding  in- 
ionnation.  supposedly  lor  his  own  good. 
Therefore  he  decided  to  try  an  experi- 
ment. He  selected  the  patient  on  his 
ward  whom  he  considered  to  be  most 
intelligent,  and  began  developing  a  close 
friendship  with  this  person.  After  they 
had  been  with  one  another  almost  con- 
stantly for  about  two  weeks,  the  patient 
■\\ho  devised  the  experiment,  confiden- 
tially asked  the  other  patient  if  he  had 
noticed  anything  peculiar  about  his  be- 
havior, explaining  that  he  wanted  to 
face  the  truth.  He  was  informed  that 
nothing  cjueer  had  been  noticed.  Again 
he  suspected  that  his  feelings  were  being 
shielded.  Only  after  a  strong  relationship 
of  confidence  had  been  developed  be- 
tween the  patient  and  one  of  the  writers, 
was  he  convinced  that  his  behavior  was 
not  peculiar. 

We    have   seen    neurotic   disturbances 
arise  in  this  manner  in  a  number  of  in- 


stances, and  feel  that  such  disorders 
shoidd  be  carefully  guarded  against  and 
watched  for  in  the  treatment  of  brain 
injiued  patients. 

It  is  important  to  stress  the  arisal  of  a 
lack  of  personal  confidence  among  brain 
injured  persons.  As  in  the  specific  case 
mentioned,  they  often  doubt  their  ability 
to  behave  and  think  properly.  There  is 
freqtiently  a  deep-seated  fear  that  things 
have  changed,  that  they  are  not  the  per- 
sons they  were  before  they  were  injured. 
This  is  reflected  in  anxious,  cautious, 
guarded  behavior. 

In  our  opinion,  affective  disturbances 
following  head  trauma  arise  as  a  mani- 
festation of  the  intricate  interplay  of 
organic  and  functional  factors.  Intel- 
lectual impairment,  caused  by  actual 
destruction  of  cortical  tissues,  may  be  a 
factor  eliciting  neurotic  disturbances. 
Further,  it  has  been  concluded  in  several 
other  studies  that  a  head  injury  may 
elicit  or  precipitate  netnotic  or  psychotic 
predispositions. 


i. 


III.  Critique  of  Tests  Previously  Used 


IN  PRiAious  Studies  (i,  '^)  tlic  Wechsler 
Mental  Ability  Scale  (Form  B) 
(MAS),  the  Rorschach,  Shipley-Hartford- 
Retreat  Scale  for  Intellectual  Imjiair' 
ment  and  the  Hinit-Minnesota  test  for 
Organic  Brain  Damage  were  considered 
in  respect  to  their  value  as  diagnostic 
aids  in  the  determination  of  brain  in- 
jury. Inasmuch  as  these  studies  were  of 
a  largely  cjuantitative  natme,  it  is  our 
jiurpose  in  this  paper  to  review  critically 
each  of  these  tests,  irrespective  of  its 
diagnostic  value,  considering  the  com- 
parative advantages,  disadvantages  and 
rationale  of  each,  l^he  MAS  has  been 
discussed  in  preference  to  the  more 
widely  used  W-B  for  the  following  rea- 
sons: (i)  The  majority  of  the  brain  in- 
jured patients  had  been  administered  the 
MAS;  (2)  The  MAS  was  extensively  used 
during  the  war  but  little  has  been  re- 
ported as  to  its  value  as  a  diagnostic 
instrument;  (3)  The  MAS  and  the  W-B 
are  so  similar  that  in  general  the  same 
criticisms  apply,  especially  since  the  ap- 
proach to  be  made  does  not  take  specific 
item  differences  into  acount. 

A.  the  WECHSLER   Ml MAL 
ABILITY  SCALE 

The  MAS,  although  diagnostically 
more  valuable  than  either  the  Hunt  or 
the  Shipley,  had  certain  undesirable 
features  which  became  evident  when 
dealing  with  brain  injured  patients.  Ob- 
servations by  the  writers  and  others  in 
clinical  situations  indicate  that  for  a 
considerable  period  of  time  following  the 
brain  damage  the  patients  fatigue  rapidl\ 
when  confionted  with  any  task  involving 
mental  effort  (1).  The  MAS,  using  10 
sub-tests,  was  found  to  be  much  too  long 
to  be  used  as  a  "one  session"  screening 
device.  The  reasons  are  obvious;  exces- 


sive fatigue  would  have  a  defniite  effect 
on  future  rapport  and  the  obtained  IQ 
or  mental  age  would  be  inireliable. 
Several  methods  were  tried  in  an  attempt 
to  offset  this  disadvantage.  (1)  The  test 
was  divided  and  given  in  two  periods. 
However,  "test  splitting"  is  undesirable 
procedure.  As  pointed  out  by  Rapaport 
(23),  "when  a  subject  takes  an  intelligence 
test,  his  performance  represents  his  ef- 
ficiency of  functioning  then  and  there." 
If  the  test  is  given  in  two  different  peri- 
ods, the  subject's  efficiency  may  be  at 
different  levels,  and  thus  introduce  an 
added  variable  which  cannot  be  ade- 
quately evaluated  in  interpretation.  (2) 
A  shortened  form  of  the  MAS  was  used. 
The  value  of  this  procedure  will  be  dis- 
cussed later.  (3)  Several  short  interviews 
were  held  before  any  actual  testing  be- 
gan. During  these  periods  the  patient 
was  oriented  as  to  the  purposes  and 
values  of  the  testing  program  and  at  the 
same  time  provided  with  the  opportunity 
for  establishment  of  a  good  patient-ex- 
aminer relationship.  However,  as  it  was 
very  often  necessary,  particularly  in  cases 
of  "closed"  head  injury,  for  the  neurolo- 
gist to  get  the  psychologist's  opinion  at 
once  as  to  whether  brain  injury  existed 
and  some  idea  of  the  degiee  of  impair- 
ment the  pre-testing  interview  situation 
was  not  always  a  satisfactory  procedure. 
It  became  apparent  that  some  short,  easy 
to  administer,  screening  measure  was 
necessary  and  valuable  in  these  cases. 

The  second  point  to  be  discussed  is 
that  of  "limited  sub-test  variety".  We 
do  not  intend  to  convey  the  impression 
that  the  types  of  mental  functions  being 
sampled  are  limited  but  that  the  "all 
\erbal"  aspect  of  the  first  half  of  the 
measure  becomes  monotonous.  The 
writer    has    experienced    numerous    in- 
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Stances  during  which  criticisms  have  been 
voiced  and  the  patient  lias  become  rest- 
less, irritable,  suspicious,  or  depressed. 
The  solution  is  to  present  the  sub-test  in  a 
different  order.  Although  the  sub-tests 
have  been  standardized  individually  and 
not  on  the  basis  of  a  certain  sub-test 
sequence,  the  effect  of  a  random  order 
presentation  on  the  reliability  and  va- 
lidity of  the  measure  is  an  open  question. 

Closely  allied  to  the  above  point  is 
the  brain  injured  patient's  extreme  sen- 
sitivity to  failure.  Most  of  these  patients 
have  a  preconceived  notion  as  to  the 
consequence  of  brain  damage.  Some  be- 
lieve that  their  injuries  have  reduced 
them  to  a  state  of  moroncy,  others,  that 
insanity  is  sure  to  follow.  These  fears 
and  the  resulting  anxiety  have  to  be 
treated  as  neurotic  manifestations.  To 
the  brain  injured  patients,  all  of  the 
verbal  sub-tests  seem  to  be  similar  and 
continued  inability  to  answer  some  of  the 
items  in  each  sub-test  acts  to  summate 
their  fears  concerning  their  mental  status. 
It  is  possible  then  to  destroy  rapport 
completely,  making  subsequent  therapy 
difficult,  creating  an  aversion  to  further 
testing,  and  instilling  a  sense  of  inade- 
quacy which  may  extend  into  depression 
or  the  adoption  of  the  "I  am  a  complete 
and  permanent  invalid"  attitude.  It  takes 
all  the  skill  that  an  examiner  can  muster 
to  prevent  this  from  occurring. 

A  few  of  the  patients  were  of  the  opin- 
ion that  certain  of  the  sub-tests  were 
"kid  stuff".  This  attitude  is  obviously 
not  conducive  to  good  rapport  or  to  ac- 
tive cooperation  and  full  effort.  Generally 
the  Block  Design,  Object  Assembly,  and 
Picture  Arrangement  sub-tests  were  the 
ones  which  aroused  these  feelings.  The 
material  used  in  the  first  and  the  types 
of  objects  assembled  in  the  second  appear 
to  be  the  reasons  for  the  dislike.  As  for 
the  third,  the  difficulty  arising  from  their 


inability  to  grasp  the  appropriate  rela- 
tionship was  expressed  by  calling  it  "a 
game  for  kids".  Although  the  presence 
ot  such  an  attitude  is  informative  since 
it  may  be  an  expression  of  personality 
dysfunction,  it  makes  scatter  interpreta- 
tion difficult.  In  this  respect  anxiety  and 
other  ncinotic  trends  are  ever  present 
j)roblems.  However,  it  is  felt  that  such 
items  tend  to  exaggerate  or  distort  the 
findings  and  certainly  lead  to  increased 
difficulty  in  differential  diagnosis. 

It  has  been  the  experience  of  the 
writers  that  for  all  the  brain  injured  cases 
the  extent  of  co-operation  and  effort 
varied  from  sub-test  to  sub-test.  This  was 
true  of  the  controls  as  well,  but  was  not 
as  marked.  Retarded  mental  efficiency, 
in  conjunction  with  all  of  the  factors 
previously  mentioned,  prevents  adequate 
control  of  interest  and  effort.  This  mo- 
tivational variance  appeared  to  result 
chiefly  from  any  or  all  of  the  following 
causes:  (i)  An  expression  of  either  a 
definite  personality  change  or  an  exag- 
geration of  certain  aspects  of  the  pre- 
injury  personality.  (2)  An  involuntary 
attention  lag.  (3)  An  attitude  of  doubt 
or  fear  occurring  when  the  previous  sub- 
test had  been  exceptionally  difficult,  and 
a  number  of  obvious  errors  had  been 
made.  These  factors  which  increase  mo- 
tivational variance  increase  the  difficulty 
of  scatter  interpretation. 

Inasmuch  as  each  sub-test  of  the  MAS 
has  been  standardized  separately,  the 
question  of  why  a  shortened  form  of  this 
test  was  not  used  may  arise.  A  short  form, 
consisting  of  Vocabvdary,  Analogies-Simi- 
larities, Digit  Symbol,  and  Block  Design 
was  tried,  but  was  found  to  have  several 
disadvantages:  (1)  the  sub-test  selection 
to  comprise  the  short  form  was  based 
on  the  assumption  that  organic  brain 
disease  and  post-traumatic  Ijrain  injury 
woidd  be  reflected  in  an  identical  man- 
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ner  by  the  patients'  performance  on  these 
sub-tests.  This  assumption  was  necessary 
because  of  the  limited  data  available  on 
post-traumatic  cases.  Our  clinical  experi- 
ence with  the  short  form  indicated  that 
it  did  not  satisfactorily  differentiate  be- 
tween brain  injured  patients  and  other 
types.  This  finding  suggested  that  on 
the  short  form  the  performance  of  pa- 
tients with  brain  injury  and  organic  brain 
diseases  are  not  directly  comparable.  For 
this  reason,  a  complete  MAS  was  admin- 
istered to  each  patient.  (2)  As  pointed  out 
previously  an  estimate  of  a  brain  injured 
patient's  level  of  performance  is  of  im- 
portance. It  gives  a  base  line  for  the  de- 
termination of  subsequent  improvement 
and.  through  the  varied  sub-tests,  specific 
deficiencies  are  indicated  which  provide 
a  sound  basis  for  re-education.  The  MAS 
and  ^Vechsler-Bellevue,  being  closely 
comparable,  are  excellent  measures  for 
the  test-retest  technique.  However,  if 
part  of  the  MAS  is  given  as  a  short  form 
and  the  entire  test  repeated  at  a  later 
date,  the  effect  of  practice  on  the  tests 
previously  used  cannot  be  adequately 
determined.  It  is  obviously  impossible, 
after  giving  the  short  form  to  merely  add 
the  remainder  of  the  sub-tests  later. 
There  is  definite  evidence  that  imjirove- 
ment  does  occur  so  that  a  test  given  in 
two  sections  at  different  dates  would  very 
likely  not  tap  the  same  level  of  general 
ability.  (^)  It  was  found  that  Analogies- 
Similarities  did  not  cjuantitati\elv  or 
qualitatively  differentiate  the  two  groups. 
An  r^j.  between  Vocabulary  and  Similari- 
ties was  foimd  to  be  .72  for  both  the 
brain  injured  and  the  controls.  Inasmuch 
as  the  site  of  injury  occasionally  extended 
into  the  motor  area,  some  patients  could 
not  take  the  Digit  Symbol  test.  This 
meant  that  in  some  cases  the  diagnostic 
value  of  the  short  form  was  dependent 
upon   the   Block  Design   test,  and  as  is 


indicated  in  Table  4,  the  validity  of  this 
test  alone  is  not  too  high. 

We  have  already  discussed  the  presence 
of  neurotic  or  psychotic  trends  in  the 
brain  injured  patient  and  have  indicated 
the  difficulty  that  these  create  in  scatter 
interpretation.  If  the  sub-tests  of  the 
Wechsler-Bellevue  which  are  affected  by 
neuroses,    psychoses,    and    brain    disease 

Table  4 
MAS  sub-test  validities 


Test 

r 
bis 

Vocabularv 

•05 

Information 

.08 

Arithmetic 

•31 

Comprehension 

.28 

Similarities 

•17 

Digit  Span 

.19 

Picture  Completion 

•23 

Picture  .Arrangement 

.27 

Digit  Symbol 

■38 

Object  Assembly 

.21 

Block  Design 

.20 

are  compared,  it  will  become  apparent 
that  at  best  differential  diagnosis  is  a  diffi- 
cult task.  It  is  admitted  that  the  M.AS 
and  W'-B  are  not  identical  but  they  are 
similar  in  content  and  we  have  findings 
to  indicate  that  they  yield  similar  results. 
If  there  are  certain  sub-tests  which  can 
be  tised  to  distinguish  between  brain  in- 
jury, neurosis,  and  psychosis  (and  it  is 
assumed  that  there  are),  the  clinician 
faced  with  a  f^rain  damaged  patient  with 
neurotic  or  psvchotic  tendencies  finds  a 
differential  scatter  analysis  extremeh 
complicated  and  almost  impossible. 

Returning  to  Table  1,  it  is  evident  that 
the  sub-test  results  could  have  been  in 
terpreted  as  indicating  the  existence  of 
either  brain  injury  or  schizophrenia. 
.Added  was  the  presence  of  a  large  num- 
ber of  irrelevant  comments,  confabula- 
tions, and  l/i/arre  resj)onses  such  as  "a 
radio  antl  a  ncwsj>aper  arc  alike  because 
they  can't  be  seen,  can't  see  radio  waves 
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or  thin  paper."  The  Rorschach  was 
strongly  suggestive  of  schizophrenia,  in- 
chiding  position  responses,  color  nam- 
ing, bizarre  responses,  contamination, 
and  confabulation.  However,  the  patient 
had  sustained  severe  brain  damage.  Most 
of  the  brain  injured  patients  gave  indi- 
cations of  at  least  mild  neurotic  disorders 
and  occasionally  a  subject's  adjustment 
showed  peculiarities  resembling  psychotic 
tendencies.  Two  patients  included  among 
the  brain  injured  cases  showed  definite 
psychotic  pictures,  each  several  months 
after  injury. 

It  has  been  our  experience  that  the 
MAS  draws  too  heavily  on  "old"  learning 
to  be  an  excellent  differential  measure. 
The  ability  to  form  new  relationships 
and  the  application  of  the  brain  injured 
patients'  present  level  of  ability  or  effi- 
ciency to  new  situations  in  the  important 
aspect  to  be  considered.  All  too  often 
the  extent  of  previous  training  and  the 
type  of  cultural  background  has  pre- 
vented adequate  analysis  of  the  sub-test 
results.  Rapaport  (23)  makes  the  follow- 
ing observation,  "it  will  be  shown,  how- 
ever, that  certain  deficiencies  due  to  edu- 
cational environment  or  assets  due  to 
cultural  predilection,  may  cloud  or  exag- 
gerate some  of  these  diagnostically  dis- 
tinguishing features  of  impairment". 

Every  clinician  is  aware  that  before 
any  psychological  test  is  to  be  given  it  is 
mandatory  that  as  much  be  known  about 
the  patient  and  his  background  as 
possible.  However,  if  there  are  certain 
educational  and  cultural  variables  pres- 
ent that  will  influence  the  performance 
on  certain  sub-tests,  the  question  of  how 
they  can  be  allowed  for  and  equated 
arises,  even  if  the  examiner  is  aware  of 
them.  Frequently  a  moderately  brain  in- 
jured and  occasionally  a  severely  dam- 
aged patient's  performance  on  the  MAS 
was  such  that  it  was  impossible  to  detect 


the  presence  of  any  intellectual  impair- 
ment. These  cases  referred  to  had  mini- 
mal sub-test  scatter  and  scores  in  the 
average  range.  To  all  appearances  they 
were  completely  normal  records.  How- 
ever, after  a  few  minutes  conversation 
and  casual  observation  it  became  very 
evident  that  they  had  suflered  an  intel- 
lectual loss.  The  Rorschach  showed  this 
very  clearly,  many  of  the  "signs"  of  post- 
traumatic cerebral  injury  being  present 
(2).  Their  intellectual  control  was  poor 
and  their  ability  was  not  being  utilized 
at  the  level  that  might  be  expected  from 
the  total  MAS  score.  In  other  words,  the 
MAS  does  not  necessarily  yield  evidence 
as  to  how  efficiently  the  indicated  ability 
is  being  employed. 

The  final  point  to  be  discussed  is  the 
question  of  validity.  Any  psychological 
test,  whether  it  be  designed  to  sample 
intellect  or  personality,  has  a  definite 
problem  in  the  establishment  of  a  cri- 
terion against  which  the  measure  can 
be  validated.  If  the  MAS  is  to  be  con- 
sidered as  a  test  of  adult  intellect  alone 
it  is  probably  as  valid  as  any  test  for 
this  purpose,  but  if  it  is  to  be  considered 
as  a  differential  measure  to  be  used  for 
the  diagnosis  of  certain  personality  dys- 
functions and  the  presence  of  organic 
brain  disease  or  damage,  we  are  faced 
with  an  entirely  different  problem.  It 
would  seem  that  brain  damage  should 
be  the  perfect  dichotomous  variable,  as 
the  pneumo-encephalogram,  neurological 
findings,  surgical  reports,  and  the  EEG 
should  establish  the  existence  of  brain 
injury  without  question.  Unfortunately 
all  is  not  as  simple  as  it  appears.  For  ex- 
ample, can  it  be  assumed  that  frontal, 
parietal,  occipital  or  temporal  injuries 
will  all  have  the  same  behavioral  resid- 
uals? Was  the  damage  focal,  diffuse,  or 
penetrating?  How  much  tissue  was  lost 
and  how  will  it  affect  performance?  These 
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neurological  aspects  alone,  some  of  which  that  they  may  form.  To  those  who  believe 

cannot  be  adequately  ascertained  while  that   the   diagnostic  value  of  the   MAS 

the  patient  lives,  arc  enough  to  indicate  consists  in  comparing  a  scatter  pattern 

the  difficulty  involved  in  determining  the  to  one  already  cstablishcd^and  by  means 

criterion   of   brain    injury.    However,    if  of  such  a  comparison  labeling  a  disorder, 

the  presence  of  tissue  damage  alone  is  it  is  suggested  that  approximately  as  valid 

considered    adequate,    there   is   still   the  results  can  be  obtained  by  guessing.  It  is 

problem  of  comparing  the  results  of  those  not  intended  to  convey  the  impression 

obtained  from  various  types  of  person-  that  the  MAS  is  a  valueless  instrument, 

ality  dysfunction.  With  this  as  a  frame  On  the  contrary,  it  has  been  found  to  be 

of  reference  and  considering  the  existence  one  of  the  most  useful.  It  has  been  em- 

of  post-traumatic  brain  injury  to  be  an  ployed   with    benefit   not    only    for   the 

acceptable  criterion,  what  is  the  ^alidity  determination  of  the  IQ  and  special  dis- 

of  each  sub-test  of  the  MAS?  abilities,     but     for    diagnosis     as    well. 

The  cases  used  were  to  some  extent  Rapaport    (24)    has    estimated    that    the 

selected.  There  were  50  controls  and  71  Wechsler-Bellevue  will  be  definitely  diag- 

brain  injured  cases  of  the  same  average  nostic  in  30-40%  of  the  cases  and  indi- 

age.    The    former    were    without    brain  cative  in  30-40%  more.  We  have  found 

damage,   considered  well   adjusted,   and  the  MAS  differentially  diagnostic  in  40% 

were  within  the  normal  range  of  intelli-  of  all  types  of  cases  and  to  show  definite 

gence.  The  latter  group  was  distributed  trends  in  an  additional  30%,  but  only 

as   follows:    Eight   cases   had   severe,   40  if  the  total  behavior  was  considered.  If 

moderate,  and  23  mild  traumatic  brain  the  scatter  pattern  alone  was  used  it  was 


injuries.  The  pre-injury  intelligence  of  found  that  we  could  be  sure  in  only  il 

the  brain  injured  group  was  estimated  of  the  records  and  get  some  indication  in 

on  the  basis  of  the  "hold"  tests  and  all  but  20%  more. 

available  Rorschach  data.  Although  this  The  MAS  and  the  Wechsler-Bellevue 
method  is  open  to  question  all  patients  have  a  distinct  advantage  in  that  they 
were  considered  to  have  been  within  the  not  only  require  a  subject  to  say  some- 
normal  range.  It  is  obvious  that  Individ-  thing  but  to  do  something  as  well.  Ob- 
ually  the  sub-tests  could  never  be  de-  servance  of  how  the  patient  reacts  to  a 
pended  upon  to  adequately  determine  situation,  his  mode  of  approach,  how  he 
the  presence  of  brain  damage.  Actually  organizes  his  thought,  and  the  interest  he 
these  validities  indicate  tliat  if  gi\en  two  shows,  are  all  of  the  utmost  importaiKe. 
groups,  one  with  and  one  without  brain  Through  tlie  use  of  Rapaport's  technique 
injury,  a  diagnosis  based  on  chance  selec-  of  "testing  the  limits"  the  scope  of  botli 
tion  would  give  comparable  results.  the  MAS  and  W-B  can  be  extensively 
These  findings,  of  course,  do  not  give  any  increased.  Only  by  adding  together  all 
direct  information  as  to  what  the  validi-  the  qualitative  and  quantitative  data  do 
ties  woidd  be  if  the  sub-tests  were  used  to  these  instruments  function  efficiently, 
differentiate  brain  injury  from  neuroses  However,  the  obvious  corollary,  a  test  is 
or  psychoses,  but  the  inference  is  that  only  as  good  as  the  person  using  it,  still 
they  would  be  even  lower.  iiolds  true.  A  high  jicrccntage  of  success- 
The  value  of  the  measure  is  not  com-  fiU  diagnosis  depends  upon  "examiner 
pletely  dependent  on  the  use  of  the  single  validity",  that  is,  on  the  background  and 
sub-tests,   nor   from   the   scatter   pattern  experience  of  the  clinician,  not  only  with 
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thf  test  itscll  but  w'nh  all  types  ot  menial 
\ariants.  Sometimes  conelusions  reu;arcl- 
ing  a  patient's  clinical  status  becomes  a 
fusion  of  tesN  performance  and  behav- 
ioral impressions  perhaps  not  e\en  con- 
nected Avith  the  actual  test  administra- 
tion. This  leads  to  the  dangerous  practice 
of  stretching  the  tests'  limitations  and 
creates  the  impression  that  the  instru- 
ment will  produce  clinical  data  beyond 
its  capability.  Both  the  MAS  and  the 
AV-B  are  fully  structured  and  as  a  result 
the  type  and  variety  of  performance  is 
limited.  They  have  a  definite  place  in  a 
battery  of  tests  but  are  not  to  be  con- 
ceived of  as  perfect  single  measures. 

Some  of  the  points  discussed  may  ap- 
pear to  be  the  effects  of  an  artificial  war- 
created  situation.  However,  a  large 
portion  of  the  cases  included  in  this 
study  received  brain  damage  after  the 
war  period  and  further,  those  patients 
who  were  injined  during  combat  or  un- 
der combat  conditions  were  well  aware, 
upon  hospitalization,  that  their  tour  of 
active  duty  was  over.  In  any  hospital, 
army  or  civilian,  the  patient  is  always 
concerned  with  his  chances  of  regaining 
his  prior  state  of  mental  or  physical 
health;  whether  or  not  he  is  improving, 
and  how  long  it  will  be  before  he  is  re- 
leased from  the  hospital.  All  of  these 
have  been  the  primary  concern  of  nearly 
every  individual  considered  in  this  study. 

B.   THE  SHIPLEY-HARTFORD  RETREAT 

SCALE   FOR   LNTELLECTUAL 

IMPAIRMENT 

In  a  previous  study  (i)  the  Shipley  was 
found  to  be  of  little  aid  in  establishing 
the  presence  of  brain  injury.  Certainly 
one  of  the  most  outstanding  reasons  for 
its  failure  to  be  of  value  lies  in  its  struc- 
ture. "The  CQ  [Conceptual  Quotient] 
scale  is  based  upon  the  clinico-experi- 
mcntal  observation  that  in  mild  degrees 


of  mental  deterioration,  and  in  other 
conditions  involving  mental  impairment, 
vocabulary  is  relatively  unaffected,  but 
the  capacity  for  Abstract  (conceptual) 
thinking  declines  rapidly"  (30).  Obvi- 
ously if  a  decline  in  concept  formation 
occurs  in  all  types  of  psychotics,  even  to 
a  limited  degree,  differentiation  between 
such  disease  entities  and  traumatic  dam- 
age is  going  to  be  nearly  impossible. 
Added  is  the  fact  that  there  is  evidence 
(1)  that  neuroses  as  well  as  psychoses  af- 
fect the  CQ.  We  are  not  questioning 
the  statement  that  the  test  indicates  the 
presence  of  impairment.  In  a  previous 
study  (1)  it  was  found  that  it  does.  How- 
ever, one  can  never  be  sure  of  the  cause. 
When  the  conceptional  quotient  (CQ) 
is  low,  all  that  can  be  safely  said  is  that 
impairment  of  some  type  is  present. 

As  has  been  stressed,  it  is  important 
in  brain  injury  to  determine  specific 
losses  in  intellectual  functioning.  The 
Shipley  can  offer  very  little  in  this  re- 
spect. The  MAS,  W-B  and  Rorschach, 
on  the  other  hand,  not  only  give  certain 
insights  in  this  respect  but  tap  other 
functions  and  aspects  as  well.  It  is  not 
enough  to  indicate  the  existence  of  im- 
pairment, as  it  leaves  the  questions  of 
the  type,  degree,  and  reason  for  the  loss 
unanswered.  It  should  be  noted  that  only 
the  extremes  of  the  categories  listed  in 
the  Shipley  manual  are  presented  here; 
therefore,  the  percentages  of  any  group, 
e.g.,  "severe",  will  not  add  up  to  100 
per  cent. 

In  comparing  two  groups,  one  with 
and  one  without  brain  injury,  it  was 
found  (1)  that  the  validity  of  the  scale,  in 
this  restricted  sense,  was  only  .25.  The 
low  validity  coefficient  at  first  was  be- 
lieved to  be  partially  caused  by  the  in- 
clusion of  a  number  of  neurotics  in  the 
control  or  non-brain  injinxd  group. 
These  cases  were  omitted  and  the  biserial 
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validity  coefficient  recomputed.  The  new 
coefficient  was  found  to  be  .30.  This  find- 
ing makes  it  apparent  that  the  presence 
of  personality  variants  was  not  alone  re- 
sponsible for  the  low  validity.  The  CQ's 
of  the  brain  injured  patients  were  then 
re-plotted  and  the  results  are  shown  in 
Table  5.  Forty-four  per  cent  of  the  total 
brain  injured  group  obtained  scores  in 


cases  tend  to  earn  low  quotients.  For  this 
reason  extreme  caution  must  be  obser\ed 
in  interpreting  cjuotients  from  individ- 
uals with  vocabulary  scores  below  23  (14 
yrs.)  (30)".  In  addition  to  the  possible 
invalidity  of  scores  for  persons  of  low 
intelligence,  an  occasional  brain  injured 
patient's  vocabulary  score  has  been  lower 
than   should   be  expected  from  the  ob- 


Table  5 

Percentage  of  brain  injured  patients  falling  into  certain 
of  Shipley's  impairment  ranges 


Severe 

Moderate 

Mild 

Total 

CQ'S 

N 

% 

N 

% 

N 

% 

N         % 

Normal 

I 

13 

8 

47 

15 

32 

24         33 

Slightly  Suspicious 

3 

38 

2 

12 

3 

6 

8          II 

Probably  Pathological 

I 

13 

I 

6 

10 

21 

12          17 

or  slightly  below  the  normal  range  and 
only  17%  received  scores  that  were  con- 
sidered "probably  pathological".  With- 
out considering  the  results  of  the  control 
group,  the  reason  for  the  low  validity 
becomes  apparent.  A  number  of  the 
brain  injured  cases  did  not  suffer  any 
demonstrable  loss  in  the  abilities  re- 
quired by  this  test.  It  is  evident  that  a 
one  aspect  measure  will  not  establish  the 
presence  of  organic  brain  damage  in 
every  case.  It  is  also  interesting  to  note 
that  some  of  the  brain  injured  patients, 
especially  in  the  mild  category,  did  not 
give  an  "organic"  record  on  either  the 
M.\.S  or  the  Rorschach  but  did  exhibit 
definite  neurotic  trends.  The  low  CQ's 
in  these  cases  may  well  be  due  to  person- 
ality disturbances.  If  this  is  true,  the 
validity  of  the  scale,  in  a  differential 
sense,  is  probably  even  lower. 

The  Shipley  is  also  limited  in  that, 
"the  available  evidence  indicates  that 
CQ's  obtained  from  sub-normals  arc  not 
valid.  Feeblemindedness  and  borderline 


tained  IQ  or  MA  on  a  Wechsler-Bellevue 
or  MAS.  Such  instances  have  been  rare 
in  our  experience  but  have  occurred. 
This  indicated  a  source  of  additional 
cases  for  whom  the  Shipley  cannot  be 
used,  inasmuch  as  each  of  these  CQ's  has 
had  to  be  considered  invalid. 

Any  self-administering  test  has  certain 
advantages  and  disadvantages  that  are 
evident  to  every  clinician.  However,  cer- 
tain of  the  disadvantages  become  more 
apparent  when  dealing  with  the  brain 
injured  patient.  An  impersonal  rclation- 
shij)  does  little  to  establish  confidence 
and  trust  in  the  psychologist.  If  the  Ship- 
ley is  used  as  a  screening  device,  regard- 
less of  how  the  test  situation  is  handled, 
little  actual  patient-examiner  relation- 
ship is  gained.  Thus  little  ojjportunity 
is  provided  for  the  establishment  of  rap- 
port which  would  be  valuable  in  further 
testing.  Of  course  this  disadvantage  can 
be  offset  by  holding  a  few  interviews  or 
gi\ing  other  tests  before  the  Shipley  is 
used,  but,  as  has  already  been  indicated, 
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its  use  as  a  screening  device  is  the  only 
possible  way  in  which  it  can  jJiofitably 
be  employed. 

We  have  noticed,  as  has  Shipley  (30), 
that  some  patients  fail  to  comprehend 
the  tlircctions,  but  more  important  are 
those  instances  in  which  the  subject  does 
not  care  to  admit  his  lack  of  under- 
standing or  has  little  interest  and  moti- 
vation. Each  of  these  situations  can  often 
be  remedied  by  good  rapport. 

Finally  the  Shipley  is  so  structured  that 
little  if  any  behavior  is  exhibited  that 
has  clinical  significance.  The  test  does 
have  certain  advantages:  (1)  It  is  very 
short,  (2)  it  can  be  administered  in 
groups,  and  (3)  if  the  interest  is  to  deter- 
mine the  presence  or  absence  of  intel- 
lectual impairment,  regardless  of  its 
cause,  the  test  is  of  value. 

C.   THE   HUNT-MINNESOTA  TEST  FOR 
ORGANIC  BRAIN   DAMAGE 

In  general  the  Hunt-Minnesota  test 
for  Organic  Brain  Damage  may  be  criti- 
cised on  the  same  basis  as  the  Shipley- 
Hartford  Retreat  Scale.  The  test  is  one 
of  limited  aspect.  It  is  true  that  there  are 
a  number  of  interpolated  tests  but  the 
scoring  standards  for  these  are  so  gener- 
ous that  they  are  of  little  or  no  value. 
It  is  our  opinion  that  these  tests  may 
have  more  diagnostic  value  than  the  T 
score  if  the  scoring  were  revised. 

The  ever  present  problem  of  validity 
must  also  be  considered.  The  results  ob- 
tained in  a  previous  study  (1)  indicate 
clearly  that,  as  far  as  post-traumatic  brain 
injury  is  concerned,  the  test  cannot  be 
relied  upon  to  adequately  detect  tlie 
presence  of  brain  injury.  It  is  interesting 
to  note  that  the  r^y  obtained  between 
the  Shipley  and  the  Hunt  was  only  .263 
which  was  not  significant  at  the  5%  level 
of  confidence.  Certainly  it  is  to  be  ex- 
pected that  two  tests,  both  supposedly 


measuring  impairment,  will  have  a  cor- 
relation coefficient  that  is  at  least  signifi- 
cantly greater  tlian  zero.  In  addition 
there  is  nothing  in  the  manual  or  in 
Himt's  article  describing  the  test  (13,  14) 
to  indicate  that  the  T  score  may  not  be 
raised  by  neurotic  difficulties  in  patients. 

The  use  of  interpolated  tests  or  ma- 
terial is  questionable  procedure,  inas- 
much as  the  possible  j^resence  of  inhibi- 
tion or  confusion  is  a  variable  that  has 
not  been  checked  experimentally.  Some 
definite  results  should  be  presented  on 
this  point  before  this  technique  is  to  be 
considered  an  acceptable  testing  method. 

In  general,  we  have  not  found  the  test 
to  be  stimulating  to  the  brain  injured 
patient.  This  factor  made  it  difficult  in  a 
number  of  cases  to  maintain  motivation 
and  prevent  unconscious  or  conscious 
malingering. 

As  with  the  Shipley,  the  structure  of 
the  test  prevents  the  manifestation  of 
much  diagnostically  valuable  overt  be- 
havior. This  largely  deprives  the  tester 
of  the  opportunity  of  observing  methods 
of  approach  and  the  mechanics  of  prob- 
lem solving  which  are  so  apparent  in 
the  Wechsler-Bellevue  or  the  MAS. 

Our  experience  and  evaluation  of  the 
Hunt  indicates  that  it  contributes  little 
to  the  understanding  of  the  brain  injured 
patient,  whether  used  ii)(li\  idually  or  as 
a  part  of  a  battery  (1). 

D.  THE  RORSCHACH  TEST 

In  a  previous  study  (2)  we  have  pro- 
posed, described  and  evaluated  various 
specific  signs  which  may  be  indications 
of  organic  cerebral  alteration.  The  Ror- 
.schach  records  and  behavioral  signs 
given  during  the  test  administration  were 
compared  in  an  experimental  group  of 
60  brain  injured  patients  and  a  control 
group  of  100  hospital  patients  without 
brain  injury.  The  ten  signs  of  organic 
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brain  injurv  that  Piotrowski  has  previ- 
ously postulated  (22)  were  investigated, 
and  five  of  them  were  found  to  be  of 
value  in  differentiating  between  post- 
traumatic brain  injured  and  control  pa- 
tients. In  addition,  nine  new  signs  were 
studied,  and  their  value  indicated.  We 
would  now  like  to  consider  the  signs 
found  to  be  helpful,  not  in  connection 
with  the  comparative  frequency  of  their 
occurrence  in  brain  injured  and  control 
groups,  but  in  respect  to  the  reasons  why 
these  signs  occur  more  frequentlv  among 
patients  with  organic  cerebral  alteration 
than  among  controls. 

Of  the  ten  signs  previously  pointed  out 
bv  Piotrowski  (22),  Impotence.  Perplex- 
itv.  Automatic  Phrases.  Repetition  and 
Color  Naming  were  found  to  be  of  value 
in  differentiating  between  the  post-trau- 
matic brain  injured  patients  and  the  con- 
trols (2).  A  considerably  higher  number 
of  neurotics  were  included  in  the  control 
group  than  would  have  been  obtained 
through  testing  a  general  run  of  hospital- 
ized patients,  inasmuch  as  many  were 
referred  for  examination  because  of 
suspected  neurotic  disturbances.  The 
ideal  situation  would  have  been  to  com- 
pare the  Rorschach  records  of  the  post- 
traumatic group  with  normals  and  with 
clear  cut  groups  from  each  of  the  neu- 
rotic and  psvchotic  classifications,  in  or- 
der to  esiablish  definitely  the  value  of 
proposed  findings  in  differential  diag- 
nosis. This,  however,  was  impossible  in 
the  situation  in  which  the  study  was 
done.  Some  practical  value  may  be 
present  in  the  approach  that  was  made 
inasmuch  as  the  results  indicate  that 
Rorschach  findings  frequentlv  differenti- 
ate post-traumatic  brain  injured  patients 
from  patients  hospitalized  primarily  for 
other  physical  disorders. 

Nine  other  signs,  named,  described 
and  evaluated  in  the  study  referred  to 


(2),  are  also  of  definite  assistance  in  deter- 
mining the  presence  of  cerebral  deficit. 
Although  it  is  of  some  value  to  obtain 
indications  of  the  presence  or  absence  of 
cerebral  deficit,  in  traumatic  cases  this 
question  is  often  answered  by  surgeon's 
reports,  pneumoencephalography,  or 
other  neurological  findings.  We  l>elieve 
that  the  principal  aim  of  psychological 
testing  in  these  cases  should  be  to  evalu- 
ate possible  intellectual  impairment  and 
information  regarding  the  psychic  ad- 
justment of  the  indi\idual  to  the  trauma. 
Therefore  we  ask  the  questions,  whv  do 
these  signs  occur  more  frequentlv  in  post- 
traumatic brain  injured  than  in  control 
patients?  What  are  the  dynamic  person- 
ality mechanisms,  either  intellectual  or 
affective,  that  cause  these  signs  to  be  pre- 
sented? 

Although  we  have  noticed  certain  per- 
sonality factors  that  may  account  for  the 
presence  of  some  of  the  signs  of  post- 
traumatic cerebral  deficit,  factors  not 
noticed  bv  us  may  also  plav  a  definite 
part.  The  interplay  of  both  intellectual 
and  affective  disturbances  is  probably 
present  as  a  cause  of  the  manifestations 
of  most  of  the  signs.  In  our  opinion  some 
of  the  signs  are  shown  as  emotional  re- 
actions to  the  recognition  of  impairment 
in  intellectual  fimctioning.  Other  signs 
probably  represent  characteristic  tech- 
niques or  behavioral  patterns  adopted 
by  brain  injured  patients  to  overcome  the 
frustration  arising  from  performance 
they  judge  to  be  imsatisfactory.  Still  other 
signs  seem  to  be  primarily  intellectual 
in  nature.  It  has  been  found  that  tlic 
intellectual  level  of  the  patient  will  af- 
fect the  signs  of  cerebral  injury  given 
(3).  We  have  been  imable  to  incorporate 
indications  of  personality  maladjustment 
such  as  anxiety,  hysteria,  depressive  tend- 
encies, or  hypochondriasis  into  the  diag- 
nostic pattern  of  brain  injur),  inasmuch 
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as   we   ha\o   been    unable    lo   (lelerniine  stereotyped  plnase  in  an   indiscriminate 

characteristic    diHercnces   in    these    Ror-  lasliion  in  more  than  liall  of  the  cards, 

schach  indications  given  by  brain  injured  and    Repetition,    or    the    occurrence    ol 

patients  and  neurotics  without  brain  in-  simihir  resjKMises  at  least  three  times  in 

jury.  'I  record  without  regard  for  form,  prob- 

Tmpotence  is  defined  by  Piotrowski  as  ably  represent  intellectual  peculiarities 
the  patient's  recognition  of  the  inade-  frequently  found  in  brain  injured  per- 
quacy  of  a  response  with  the  inability  to  sons.  Possibly  these  types  of  behavior 
either  withdraw  or  improve  it.  This  sign  arise  because  they  represent  easy  ways  to 
is  probably  related  to  the  intellectual  complete  the  test— a  tendency  to  follow 
impairment  often  present  following  trau-  the  path  of  least  resistance.  Observations 
matic  brain  injury  and  also  to  the  adjust-  and  questioning  indicate  that  these  signs 
ment  of  the  individual  following  injury,  are  given  without  the  patient's  awareness. 
Specifically,  this  seems  to  be  a  manifesta-  They  do  not  intentionally  resort  to  these 
tion  of  the  deep  feeling  of  uncertainty  methods  in  order  to  make  the  task  easier, 
and  lack  of  personal  confidence  which  At  least  one  occurrence  of  Color  Nam- 
we  have  seen  in  many  of  these  cases.  The  ing  has  been  considered  a  particularly 
headaches,  confusion,  dizziness,  retarda-  important  sign  in  cases  with  organic  in- 
tion  of  thought,  and  other  organically  tracranial  pathology  (16),  but  in  our 
determined  symptoms  usually  following  study  of  post-traumatic  brain  injured 
severe  head  trauma  probably  contribute  cases,  it  was  somewhat  less  important, 
to  the  patient's  lack  of  personal  confi-  Kelley  considers  color  naming  an  indica- 
dence.  The  patient  feels  that  he  must  give  tion  of  ".  .  .  the  confusion  of  the  patients 
some  responses,  but  he  is  not  sure  in  relation  to  the  environment  and  rep- 
whether  he  is  behaving  properly.  He  does  resents  the  emotional  lability  and  insta- 
not  know  if  his  post-injury  behavior  is  bility  which  occurs  so  often", 
revealing  peculiarities  unknown  to  him-  Consideration  of  the  Ink-blots  as  Rep- 
self.  Therefore  he  gives  responses,  doubts  resentations  of  Actual  Objects,  Concrete 
their  adequacy,  but  is  unable  to  with-  Responses,  and  Inflexibility  or  the  in- 
draw  or  improve  them  because  he  does  ability  to  use  any  part  of  any  of  the  ten 
not  know  what  to  give  in  their  place.  figures  for  more  than  on  association,  are 

Perplexity,  or  the  subject's  distrust  of  signs  which  are  closely  allied  with  the 

his  own  ability  and  a  request  for  assur-  type  of  impairment  discussed  by  Gold- 

ance,   seems   to   be   very  similar   to   Im-  stein  when  he  considers  the  inability  of 

potence  in  regard  to  the  reason  for  its  brain  injured  to  assume  the  abstract  at- 

manifestation.  It,  too,  probably  springs  titude  (9). 

from  a  lack  of  personal  confidence  which  Consideration  of  the  Blots  as  Actual 

may  well  have  been  accentuated  by  the  Objects  springs  from  the  brain  injured 

subject's    recognition    of    temporary    or  patients'  dependence  for  association  upon 

permanent    impairment    in    intellectual  concrete  stimuli.  An  extreme  form  of  this 

functioning.    As    previously    mentioned,  type  of  behavior  is  extensively  described 

the  "psychic  value"  of  the  head  has  been  and  discussed  by  Hanfmann,  Ovsiankia, 

noted   in   many   cases   as   an   additional  and  Goldstein   (12).  This  patient  often 

factor   in   the  development  of  personal  spoke  to  persons  in  pictures,  failing  to 

uncertainty.  recognize    that    they    were    not    actual 

Automatic   phrases,   or   the   use   of   a  people.    The    sign    Concrete    Responses, 
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scored  when  a  record  gave  no  indication 
of  association   involving  the  quality  or 
attributes  of  responses,  is  obviously  re- 
lated to  a  lack  of  the  assumption  of  the 
abstract  attitude.  W'c  do  not  suggest  that 
this  sign  necessarily  represents  an  impair- 
ment in  the  ability  to  assume  an  abstract 
attitude,   but   it   has   been   found   much 
more    frequently    among   brain    injured 
patients  than  controls.   Inflexibility  has 
been  noted  by  various  writers,  using  a 
number  of  experimental  procedures,  as 
the  brain  injured  patient's  inability  to 
shift.  This  behavior  is  also  considered  to 
be  a  manifestation  of  inability  to  assimie 
the  abstract  attitude.  Kelley  (16)  quotes 
Bolles  and  Goldstein  to  substantiate  this 
position,  "He  (brain  injured  patient)  is 
unable  to  shift  from  one  type  of  attitude 
to  another  voluntarily".  This  voluntary 
shifting  according  to  Goldstein,  presup- 
poses the  capacity  for  the  abstract  atti- 
tude or  categorical  behavior.  Weigl  also 
studied    this   phenomenon   and   verified 
the  findings  of  Goldstein,  believing  that 
the    normal    could    classify    on    various 
bases,  whereas  the  brain  injured  patient 
once  having  adopted  a  specific  classifica- 
tion could  not  shift  to  another.  Kelley 
concludes,  "this  inability  of  the  patient 
to  shift  his  concepts  even  though  an  obvi- 
ously good  form  is  offered  (suggested  by 
the  examiner)  seems  to  be  definite  indica- 
tion    of     the     impairment    of    abstract 
behavior.    If    j^rcscnt    it    points    almost 
pathognomonically     to     organic     intra- 
cranial damage  or  to  a  schizophrenic  proc- 
ess". It  must  be  noted  that  Kelley  elicits 
this    sign    by    suggesting   alternative   re- 
sponses to  the  patient  during  the  "testing 
the  limits"   period.    It  may   be   inferred 
from  the  previously  given  definition  of 
our  sign.    Inflexibility,   that   it  is  deter- 
mined by  scrutiny  of  the  responses  given 
during  the  test  perio<l. 

Unclear  definitions   of  responses  had 


been  found  to  be  one  of  the  most  helpful 
signs  in  differentiating  between  post- 
traumatic brain  injured  and  control  pa- 
tients (2).  It  is  probably  primarily  a  mani- 
festation of  the  intellectual  impairment 
suffered  by  many  patients  with  organic 
cerebral  deficit.  Its  principal  difficulty 
in  practical  use  is  that  judgment  of  its 
presence  is  largely  based  on  subjective 
consideration,  and  thus  its  value  relies 
heavily  upon  the  experience  of  the  ex- 
aminer. 

The  personality  mechanisms  giving 
rise  to  the  sign  Edging  are  in  doubt.  Beck 
states  that  in  his  experience  edging  is 
exclusive  schizophrenic  behavior,  but  we 
have  noted  it  in  41.6  per  cent  of  a  group 
of  60  brain  injured  patients  and  in  17 
per  cent  of  a  group  of  100  control  pa- 
tients including  neurotics  (6).  Beck  ex- 
plains the  sign  among  schizophrenics  by 
saying  that  it  ".  .  .  is  simply  another 
peculiarity  with  which  these  patients  re- 
act to  stimuli  and  handle  their  problems. 
How  much  it  projects  a  captious  caiuion, 
alien  to  normal  procedure,  and  how 
much  it  is  odd  posturing,  I  am  not  ready 
to  say"  (6). 

Irrelevant  comments,  or  the  expression 
of  a  statement  during  the  testing  situ- 
ation which  is  not  in  any  noticeable  way 
pertinent  to  the  test,  has  been  observed 
in  patients  with  brain  injury.  This  sign 
may  be  factors  basic  to  this  districtibil- 
ity  of  the  brain  damaged  patient,  which 
has  been  discussed  by  Goldstein  (8).  Im- 
pairment in  attention  and  concentration 
may  be  factors  basic  to  this  distractabil- 
ity.  In  addition,  it  is  entirely  possible 
that  this  behavior  may  be  partially 
caused  by  the  patient's  desire  to  escape 
the  testing  situation  at  least  temporarily; 
a  situation  which  accentuates  the  lack  of 
self-confidence  which  has  been  seen  in  a 
large  percentage  of  brain  injured  pa- 
tients. 
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Covers  Parts  of  Cards  and  \Vithdrawal 
and  Re-attack  are  signs  that  also  have 
been  noted.  The  first  occurs  when  die 
patient  excludes  part  of  the  ink-blot 
from  his  vision  with  his  hands.  The 
second  is  present  when  a  subject  volun- 
tarily removes  his  attention  from  a  card, 
perhaps  turning  the  card  over  or  looking 
in  another  direction,  and  suddenly  re- 
news his  scrutinv.  We  believe  that  these 
signs  are  behavioral  patterns  which 
spring  from  a  recognition  of  inadequate 
performance  and  thus  permit  the  patient 
to  escape  a  more  distinct  recognition  of 
inadequaq.'  with  more  intense  feelings 
of  frustration.  Other  factors  are  probablv 
also  involved.  Covering  parts  of  the  cards 
may  be  an  attempt  to  combat  distracti- 
bilitA'  bv  excluding  stimuli  other  than 
those  selected  for  immediate  scrutinv  and 
concentration.  ^Vithdra^^•al  and  Re-at- 
tack may  be  partially  an  attempt  to  get 
a  new  %-iew  of  the  situation,  a  different 
mental  set.  In  this  respect  it  is  related  to 
the  "inabilitv  to  shift"  seen  in  certain  of 
the  sub-tests  of  the  screeninor  de\'ice  pre- 
sented later  in  the  paper. 

Catastrophic  Reaction  is  a  sign  which 
probably  represents  the  failure  of  manv 
of  the  signs,  previously  discussed,  in 
meeting  the  patient's  attempt  to  escape 
frustration.  Many  of  the  other  signs  were 
explained,  at  least  in  part,  as  mechan- 
isms used  to  satisfy  the  deep  feeling  of 
personal  inadequacy,  accentuated  bv 
recognized  intellectual  impairment,  in 
many  brain  injured  persons.  Our  obser- 
vation has  indicated  that  these  other 
signs  are  first  sho^\-n  bv  the  patient  and 
when  a  catastrophic  reaction  occurs,  it  is 
a  culmination  of  growing  feelings  of  frus- 
tration which  could  not  be  averted  bv 
expression  of  the  other  signs.  The  fact 
that  Catastrophic  Reaction  was  found 
in  31.7  per  cent  of  the  brain  injured  and 


only  1  per  cent  of  the  controls,  and  iiu- 
ther  tliat  73  per  cent  of  the  severely  in- 
jured showed  this  sign,  substantiates  this 
theory.  It  is  to  be  expected  that  fewer 
brain  injured  patient?  would  manifest 
catastrophic  reactions  than  the  other  re- 
lated signs.  The  otlier  types  of  behavior 
are  used  first,  but  when  the  test  pro- 
gresses and  these  are  not  satisfactorv,  it 
is  necessan."  to  make  a  frank  admission 
of  frustration  by  engaging  in  a  catastro- 
phic reaction.  It  should  be  mentioned 
that  Goldstein  (8)  has  described  and  dis- 
cussed these  reactions  arising  among 
brain  injured  persons  in  other  situations. 

M'e  must  emphasize  that  the  Rorschach 
signs  shown  by  the  post-traumatic  are  not 
necessarily  restricted  to  this  group.  A 
previous  study  has  shown  that  they  occur 
much  more  frequently  among  the  brain 
injured  than  in  a  control  group  of  hos- 
pitalized patients,  including  manv  neu- 
rotics but  no  one  with  central  nen'ous 
system  disorder  (2).  However,  it  is  quite 
possible  that  psvchic  dvnamisms  in  many 
persons  could  cause  the  manifestation  of 
at  least  some  of  these  signs.  The  actual 
value  of  these  signs  in  differential  diag- 
nosis  can  be  determined  only  when  con- 
trolled studies  have  been  made  compar- 
ing post-traumatic  brain  injured  cases 
^sith  selected  groups  of  persons  with 
various  psychotic  and  neurotic  disorders. 

In  our  previous  study  it  was  possible 
to  detect  indications  of  typical  "organic 
brain  injurv"  manifestations  by  use  of 
the  Rorschach  in  a  high  percentage  of 
the  patients  with  post-traumatic  cerebral 
injuiy.  In  the  experimental  group  70  per 
cent  were  considered  as  "definitely  brain 
injured"  and  14  per  cent  were  evaluated 
as  showing  "significant  indications  of 
brain  injurs".  Although  most  of  the  re- 
maining 16  per  cent  gave  at  least  one  of 
the  signs  we  have  found  to  be  typical, 
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the  signs  were  not  present  in  snffitient 
(jiiaiitity  or  degrees  of  intensity  to  justify 
consideration  as  significant. 

It  will  be  of  interest  to  consider  the 
basis  on  which  the  classifications  of  "defi- 
nite brain  injury"  and  "significant  indi- 
cation of  brain  injury"  were  assigned.  In 
our  opinion,  a  procedure  of  merely 
counting  the  number  of  signs  present  (3) 
will  not  give  satisfactory  results.  Un- 
doubtedly some  cases  would  be  correctly 
classified  if  this  method  were  followed, 
but  further  considerations  are  necessary 
for  more  accurate  work.  We  ha\e  found 
three  points  to  be  most  important:  (1) 
The  intelligence  level  of  the  subject;  (2) 
the  number  of  signs  present;  and  (3) 
the  intensity  of  these  signs.  The  intelli- 
gence level  is  important  because  the 
number  of  signs  present  has  been  found 
to  decrease  as  the  intelligence  level  in- 
creases (3).  The  absolute  number  of  signs 
given  must,  of  course,  be  considered  in 
regard  to  their  experimentally  deter- 
mined significance  in  differentiating  be- 
tween brain  injured  and  control  patients 
(2).  The  intensity  with  which  the  signs 
are  given  can  best  be  evaluated  only  after 
considerable  experience  with  these  pa- 
tients. This  point  should  not  be  disre- 
garded (although  the  weight  placed  on 
these  judgments  must  be  determined  by 
the  experience  of  the  tester),  because  it 
has  been  found  to  be  of  definite  clinical 
value.  Some  brain  injured  patients  give 
relati\ely  few  signs,  but  the  great  in- 
tensity often  justifies  assumption  of  the 
presence  of  brain  damage. 

It  is  also  sometimes  of  verifying  value 


to  consider  the  results  of  other  tests  and 
the  past  history  of  the  patient  in  attempt- 
ing to  determine  if  the  level  of  perform- 
ance indicated  by  the  Rorschach  roughly 
agrees.  It  is,  of  course,  hazardous  to  base 
conclusions  on  this  comparison  alone. 
Certain  neurotic  tendencies,  viz.,  anxiety, 
hypochondriasis,  and  depression,  are  fre- 
quently indicated  by  the  Rorschach  in 
cases  of  brain  injury.  However,  we  have 
found  no  way  in  which  these  indications 
in  themselves  differ  from  those  given  by 
neurotics  without  brain  injury. 

A  brief  evaluation  of  the  Rorschach 
will  be  made  in  comparison  to  the 
AV'^echsler-Bellevue,  MAS,  Shipley  and  the 
Hunt.  Our  studies  have  indicated  that 
the  presence  of  organic  cerebral  altera- 
tion is  more  frequently  indicated  by  the 
Rorschach  than  by  the  other  tests  men- 
tioned. Obviously  this  is  due  to  its  ability 
to  tap  areas  of  possible  impairment  be- 
yond the  scope  of  the  other  tests.  It  has 
certain  disad\antages  such  as  its  length 
and  its  appearance.  Even  in  the  hand  of 
a  skilled  examiner,  the  test  tends  to 
arouse  suspicion,  which  in  all  probability 
arises  from  its  unstructured  nature.  Per- 
haps the  greatest  drawback  to  its  use  lies 
in  the  degree  of  interpretative  skill  neces- 
sary which  comes  only  with  extensive 
experience  and  training.  The  test  is  also 
open  to  the  same  fault  as  the  MAS  or 
\V^-B  in  that  the  limits  of  the  test  can  be 
exceeded.  To  be  sure  it  is  the  best  single 
measure  that  we  have  used  for  the  pur- 
pose of  detecting  brain  injury;  however, 
it  functions  most  efficiently  when  it  is 
used  as  a  part  of  a  battery. 


IV.   RlX>l'lREMENTS  FOR  A  SCREENING  TeST 


FROM  the  discussion  ol  the  MAS, 
Shipley,  Hunt  and  the  Rorschach  it 
is  apparent  that  a  screening  device  would 
be  a  valuable  addition  to  a  battery  ol 
tests  to  be  used  with  brain  damaged  pa- 


operates  efficiently  for  cases  of  suspected 
injury  might  be  too  difficult  for  persons 
with  severe  cerebral  disturbances.  Ihis 
can  be  compensated  for  by  using  only 
sub-tests  which  are  of  exceptional  inter- 


tients.   It  ^\ould  cliniinate  the   frequent      est,  allowing  added  time,  and  skillfully 


problem  of  the  need  for  quick  diagnostic 
aid  and  at  the  same  time  provide  land- 
marks for  further  testing.  To  do  this 
efficiently  certain  prerequisites  must  be 
met.  The  following,  although  not  all  in- 
clusive, are  certainly  basic. 

1.  The  measure  must  be  short.— This 
prevents  fatigue  and  assures  good  rapport 
as  short  interviews  can  be  held  both  be- 
fore and  after  the  test  without  prolonging 
the  initial  meeting. 

2.  Interesting.— It  is  essential  to  deter- 
mine the  presence  or  absence  of  mental 
impairment.  If  this  evaluation  is  to  be 
reliable  and  valid,  the  tests  must  catch 
and  hold  the  interest  of  every  patient. 

3.  Easy.— It  is  understood  that  a  per- 
fect measure  would  be  one  on  which 
neither  a  zero  nor  a  perfect  score  could 
be  obtained.  This  is  difficiUt  to  attain  as 
included  in  the  frame  of  reference  must 
be  the  consideration  that  every  brain  in- 
jured case  must  experience  success.  In 
addition,  this  success  must  be  apparent 
to  him.  The  habit  of  saying,  "good", 
"fine",  or  "you  did  well  on  that  one", 
does  not  suffice.  In  fact,  constant  repeti- 
tion of  those  phrases  in  the  face  of  actual 


giving  a  few  hints  in  the  event  of  initial 
failure.  If  this  procedure  is  accomplished 
with  care  the  patient  will  look  upon  the 
added  help  as  part  of  the  test  and  will 
consider  the  solution  his  own. 

4.  Relatively  unaffected  by  neurotic 
trends.— As  has  been  pointed  out,  the 
diagnostic  value  of  any  measure  is  de- 
pendent upon  its  ability  to  present  a 
clear  cut  differential  picture. 

5.  Sample  those  functions  that  secyn  to 
suffer  most  as  a  result  of  brain  injury.- 
If  there  are  certain  abilities  which  are 
usually  impaired  by  brain  damage,  and 
if  these  can  be  isolated,  it  would  then  be 
possible  to  construct  an  experimental 
differential  measure.  As  indicated  by 
Wechsler  (32)  and  in  our  previous  study 
(1)  it  appears  that  certain  intellectual 
functions  have  suffered  more  than  others. 
These  findings  did  not  apply  to  every 
case  of  brain  injury  but  were  based  on 
the  mean  scores  of  the  total  group.  Using 
these  results  as  guides,  a  test  to  be  dis- 
cussed in  detail  later,  has  been  assembled. 

6.  U7iderstandability.—By  this  is 
meant  the  development  of  a  feeling,  on 
the    part   of   the   patient,    that   the   test 


or  suspected  failure  may  induce  suspicion  being  given  is  appropriate.  Most  of  the 

and  result  in  the  patient's  loss  of  confi-  subjects  form  opinions,  right  or  wrong, 

dence   in   the   examiner.   The   test   as   a  as  to  what  the  test  is  testing.  If  a  possible 

whole  has  to  be  easy,  as  some  brain  in-  reason  for  a  particular  item  is  not  ap- 

jured  patients  experience  a  definite  loss  parent  they  become  suspicious  as  to  its 

in  mental  efficiency.  As  a  consequence,  purpose  and  usually  express  these  feel- 

a  test  which  is  satisfactory  for  patients  ings  in  such  statements  as,  "I  don't  see 

with  definite  intellectual  loss,  might  not  how  this  will  help  me  to  get  any  better", 

be   adequate   in   cases   of   mild   or  only  It  is  neither  feasible  nor  good  technicjue 

suspected  injury.  Conversely,  test  which  to  explain  each  test  in  advance.  If  the 
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items  can  appear  appropriate,  irrespec-  lo.   The  test  should  he  reliable. 

tive  of  their  underlying  purpose,  it  is  a  ii.  Directions  should  be  simple,  dear 

distinct    acKantage    in    establishing   and  and  easily  understood. 

maintaining  rapport  and  also  has  a  deft-  12.  All  performance  tests  should  be  of 

nite  therajieutic  effect.  The  patient  feels  such    nature    that    they   can    be   accom- 

that   the   entire   procedure   is   aimed   at  plished  by  gross  muscular  movements.— 

discovering  aids  to  alleviate  his  particu-  We  have  encountered  a  number  of  in- 

lar  difficulty.  stances  when   it  became  difficult  to  in- 

7.  Hax'e  a  minimum  dependence  on  lerpret  scores  from  such  tests  as  the  Digit 
previously  learned  material.— Thh  has  Symbol.  To  do  well  on  this  test  fine  pre- 
already  been  discussed  in  detail.  How-  cise  muscular  movements  are  required 
ever,  a  fundamental  consideration  is  the  and  if  the  injury  is  diffuse  it  is  possible 
ability  of  the  patients  to  form  new  rela-  that  motor  area  involvement  may  have  a 
tionships  and  to  apply  their  present  level  definite  effect  on  the  performance.  That 
of  ability  to  new  situations.  is,    an   added   variable   has   been    intro- 

8.  Performance  items  should  be  in-  duced,  the  presence  and  degree  of  effect 
eluded.— This  insures  an  adequate  sample  of  which  cannot  be  readily  determined. 
of   the   patient's   total  behavior.  In  addition   there  are  a  number  of  in- 

g.  Validity.— The  examiner  should  have  stances  where  the  ability  to  employ  gross 

data  available  which  indicates  the  degree  movements    has    remained    unimpaired 

to  which   the   test  can   be  relied  on   to  while  more  specific  movements  have  been 

measure  what  it  is  intended  to  measure,  destroyed. 
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\'.  Proposed  Screening  Test 


A.    MEIHODS   AND    PROCEDL'RE 

THK  FiNniNGs  obtained   from  a  com- 
parison   of    MAS    results    from    a 
group  of  brain  injured  with  a  group  of 
controls  (i)  can  be  divided  roughly  into 
two  general  classifications;  those  that  ap- 
peared to  be  definite,  and  those  that  were 
suggestive.  The  former  were  considered 
to  be  losses  in;  (i)  analysis  and  synthesis, 
(a)  ability  to  shift,  and  (3)  ability  to  learn. 
The  latter  category  included  losses  in  (1) 
ability  to  integrate  two  points  of  view 
or  to  perceive  a  double  relationship,  (2) 
ability  to  plan  ahead,  (3)  ability  to  antici- 
pate, (4)  ability  to  stick  to  a  point.  (This 
loss  seemed  to  hinge  upon  the  continuity 
and  organization  of  the  patient's  think- 
ing and  approach),  (5)  definite  persever- 
ative   trends,   and   (6)    possible   memory 
defect.  In  order  to  (a)  check  these  find- 
ings,   (b)   study   the   capabilities   of   the 
brain    injured   patient   further,   and    (c) 
attempt   to   construct   a   workable  valid 
screening    device    for    the    detection    of 
brain    injury,    a    five    item    test   was   as- 
sembled.   Each   of   these   sub-tests   were 
considered  from  a  dual  standpoint.  First, 
did    they    individually    and    collectively 
satisfy   the   previously  discussed  criteria 
for     the     adequate     screening     device? 
Second,  did  they  test  those  intellectual 
functions  which  had  been  thought  to  be 
definitely  vulnerable  and  even  more  im- 
portant,   to    sample    those    which    were 
considered    questionable?    None    of    the 
items    adopted    are    original.    Three    of 
them  are  parts  of  the  Army  Individual 
Test  (4),  which  has  not  yet  been  released 
for  civilian  use.  Each  item  will  be  dis- 
cussed in  regard  to  structure  and  admin- 
istration (including  scoring). 

B.    CASE   MATERIAL 

The  brain  injured  group  consisted  of 
44  patients  who  were  known   to  have 


sustained  cerei^ral  damage.  The  e\  idcnce 
was  derived  largely  from  surgeons'  re- 
ports. In  the  instances  where  these  were 
lacking,  positive  pneumo-encephalograms 
and/or  neurological  findings  were  avail- 
able. The  source  of  these  injuries  ranged 
from  high  velocity  missiles  to  auto  acci- 
dents. In  regard  to  the  severity  and  type 
of  injury  the  neurologist  distributed  the 

Table  6 

Post-injury  intelligence  level  of  the 
brain  injured  group 


Intelligence 
Quotients 


Brain  Injured 

Group 
N  Per  Cent 


75-  79 

6 

14 

80-  89 

IX 

25 

QO— log 

24 

54 

Over  1000 

3 

7 

44  cases  as  follows:  11  severe,  21  moder- 
ate, and  12  mild;  9  were  considered  to 
have  focal  lesions,  17  were  classed  as 
focal-diffuse  and  18  were  diffuse.  The 
pre-injury  intellect  of  these  patients  was 
determined  by  the  previously  described 
method;  18  per  cent  were  dull  normal, 
66  per  cent  average  and  16  per  cent  above 
average.  The  present  level  of  capability 
was  determined  by  the  use  of  the  MAS. 
The  distribution  of  the  total  scores  or 
IQ's  is  shown  in  Table  6.  As  had  already 
been  indicated  the  IQ  does  not  indicate 
the  true  intellectual  status  of  these  pa- 
tients and  should  be  interpreted  with  cau- 
tion. 

The  control  group  was  composed  of 
two  sub-divisions,  normal  and  neurotic. 
The  former  (N  =  45)  consisted  of  hos- 
pital attendants  considered  to  be  well 
adjusted,  within  the  normal  range  of 
intelligence,  and  had  neither  received  a 
head  injury  nor  had  record  of  any  type 
of  disease  that  might  have  resulted  in 
intracranial  pathology.  The  latter  (N  = 
16)  was  3  group  of  patients  with  mild 
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affective  states,  all  of  whom  had  just 
started  to  undergo  psychotlierapy  at  the 
time  of  testing.  None  of  them  had  a  his- 


Table  7 

Site  of  the  trauma 

Brain 

Injured 

Group 

N 

Per 

Cent 

Frontal  (left  or  right) 

ID 

22.7 

Frontal-temporal  (left  or  right) 

I 

2.3 

Parietal  (left  or  right) 

5 

11.4 

Parietal  (vertex) 

1 

2-3 

Temporal  (left  or  right) 

2 

4-5 

Temporal-parietal  (left  or  right) 

6 

13.6 

Occipital  (left  or  right) 

3 

6.8 

Occipital-temporal  (left  or  right) 

I 

2.3 

Occipital-parietal  (left  or  right) 

TO 

22.7 

Left  frontal-left  parietal    (pene- 

trating) 

I 

2-3 

Right      occipital-right      frontal 

(penetrating) 

I 

2-3 

Generalized 

3 

6.8 

tory  of  head  injury  and  all  were  within 
the  normal  range  of  intelligence.  The 
intelligence  breakdown  was  as  follows: 
15%  were  dull  normal,  65%  average, 
and  20%  were  above  average. 

Because  the  samples  are  small,  each 
group    will    be    described    as    fiUly    as 


possible  to  determine  the  existence  of 
any  outstanding  diflerenccs  that  might 
account  for  the  obtained  cjuanitati\e  and 
qualitative  results  to  be  discussed  later. 
The  composition  of  the  brain  injured 
group,  from  the  standpoint  of  the  site  of 
the  trauma  is  summarized  in  Table  7. 

The  question  may  arise  as  to  the 
possible  effect  of  aphasic  distiubances  on 
the  obtained  test  results.  The  brain  dam- 
aged group  included  only  two  cases  with 
a  history  of  such  disorders.  Both  were 
excluded  from  the  obtained  residts  to 
determine  their  effect  on  the  final  "t" 
values.  In  every  case  their  exclusion 
tended  to  slightly  increase  the  obtained 
differences. 

Inter-group  comparisons  have  also 
been  made  on  the  basis  of  age,  level  of 
edtication,  and  pre-injury  occupation. 
From  each  of  these  aspects  the  two  groups 
do  not  appear  to  have  any  outstanding 
differences. 

Finally  all  of  the  brain  damaged  cases 
received  their  injuries  at  least  six  months 
prior  to  testing.  Accordingly,  any  differ- 
ences that  may  be  found  are  not  the  re- 
sult of  a  transitory  condition  but  reflect 


Table  8 
Age  and  education  distributions 


Brain 
Injured  Cases 


Neurotics 


Normals 


Total 
Controls 


Educational  Level 


-  Levels 

N 

% 

N 

% 

N 

% 

N 

% 

Below  Eighth  Grade 
Eighth  Grade 
Ninth  to  Eleventh  Grade 
High  School  Graduate 
College  Level 

I 
10 

14 

15 

4 

2-3 

^^22. 7 

31.8 

Ti34-o 
9.1 

6 

18.8 

43-8 
37-5 

I 

9 

5 
13 

7 

2.9 
25-7 
14-3 
37-1 
20.0 

I 
12 

5 
20 

13 

2  .0 

23-5 

9.8 

39-2 

25-5 

Age 

Level 

Below  1 9  Years  of  Age 

3 

6.8 

I 

6.3 

I 

2.9 

2 

3-9 

20-24  Years  of  .Age 

14 

31.8 

7 

43-8 

13 

37-1 

20 

39-2 

25-29  Years  of  .Age 

IS 

340 

2 

12. 5 

8 

22.9 

10 

19.6 

30-34  Years  of  Age 

3 

6.8 

2 

12.5 

S 

14-3 

7 

13-7 

Over  35  Years  of  .Age 

9 

20.5 

4 

25.0 

8 

22.0 

12 

23-5 

t 
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lelatiNcly  permanent  residuals  of  the  in- 
jury. 

C.   RESULTS 

/.  Memory  Tests 

7  he  sub-tests  to  be  discussed  arc  pre- 
sented in  actual  testing  order. 

The  first  to  be  considered  is  a  test  of 
memory.  This  type  of  item  was  included 


levels  (31).  It  is,  omitting  articles  and 
( on  junctions,  a  67-word  story  of  a  mili- 
tary nature.  The  content  is  well  organ- 
ized, cohesive,  and  interesting.  Proper 
names,  distances,  times,  directions,  etc., 
are  included  but  there  is  no  part  or  sec- 
tion that  introduces  the  principle  of  "iso- 
lation". 
The  directions  are  simple.  The  subject 


Table  9 
Occupational  distribution 


Occupations 

Brain  Injured 
Cases 

Controls 

N 

% 

N 

h% 

Architect 

I 

2-3 

Baker 

2 

3-9 

Carpenter 

2 

3-9 

Clerk 

I 

2.3 

4 

7.8 

Dentist 

I 

2  .0 

Farmer 

9 

20.5 

4 

7.8 

Hotel  Manager 

I 

2-3 

Laborer 

14 

31.8 

14 

27-5 

Lithographer 

I 

2  .0 

Machine  Operator 

6 

13-6 

Mechanic  (auto) 

5 

II. 4 

4 

7.8 

Musician 

I 

2-3 

Salesman 

S 

9.8 

Student 

5 

II. 4 

II 

21.6 

Teacher 

2 

3-9 

Welder 

I 

2-3 

I 

2.0 

for  two  reasons;  (1)  A  number  of  the 
patients  indicated  that  their  ability  to 
retain  and  recall  had  been  altered  by  the 
injury  sustained.  The  nature  of  these 
complaints  ranged  from  memory  lapses 
such  as  forgetting  to  mail  a  letter,  to  the 
inability  to  recall  what  had  just  been 
read  or  heard.  (2)  The  MAS,  like  the 
\V-B,  does  not  have  a  direct  memory  test. 
As  pointed  out  by  Rapaport  ".  .  .  the 
most  serious  shortcoming  of  the  Bellevue 
Scale  is  the  fact  that  it  contains  no  sub- 
test which  tests  memory  function  in  a 
more  direct  way  than  the  information 
sub-test"  (23). 

The  item  is  similar  to  those  used  in 
the  Terman  and  Merrill  revision  of  the 
Stanford-Binet  at  the  X  year  and  SA  II 


is  told  that  something  is  going  to  be  read 
and  that  when  it  is  finished  he  is  to  tell 
the  examiner  all  that  he  can  remember 
about  it  in  his  own  words.  Just  prior  to 
the  reading,  there  are  the  usual  cautions 
to  insure  the  patient's  attention.  The 
selection  is  then  read.  Care  is  taken  to  be 
sure  that  the  reading  rate,  for  the  entire 
selection,  falls  oetween  35  and  40  seconds 
for  every  subject.  The  examiner  should 
avoid  a  bored  or  affected  tone  and  obvi- 
ously emphasis  should  not  be  placed  on 
names,  distances,  directions,  etc.  Scoring 
is  similar  to  that  used  in  the  Binet.  On 
the  score  sheet  the  story  has  been  broken 
down  into  nearly  equal  thirds.  Every 
third  includes  ten  "memories"  with  the 
exception  of  the  last.  These  are  checked 
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by  the  examiner  as  they  are  related.  A 
degree  of  leeway  is  allowed.  That  is,  ii 
the  patient  has  expressed  the  essential 
element  ot  a  "memory"  but  the  wording 
is  not  identical,  credit  is  given.  However, 
dates,  times,  distances,  directions,  names, 
etc.,  have  to  be  absolutely  accurate  to 
obtain  credit.  Following  the  free  associ- 


disordcrs  of  form  and  organization  of 
thought  such  as  circumstantiality,  block- 
ing, impoverished  thinking,  persevera- 
tion, rambling,  pseudo-profundity,  and 
confabulation.  Also  variations  in  the  rate 
and  progression  of  the  stream  of  thought 
can  be  detected.  In  short,  the  item  can 
be  evaluated  quantitatively  and  qualita- 


Table  10 

Distribution  constants  obtained  in  quantitative 
analysis  of  the  memory  test 


Brain  Injured 

Neurotics 

Normals 

Total  Controls 

M 

S.D. 

M 

S.D. 

M 

S.D. 

M 

S.D. 

I  St  5  Free  Association 

2nd  ^  Free  Association 

3rd  I  Free  Association 

Total  Free  Association 

Questions 

Total  Memory  Score 

3-66 
2.91 

2-95 

9-52 

6.86 

16.39 

2.00 
2.29 
1.92 
4.86 

3-37 
7.82 

S-56 

4-94 

4.19 

14.69 

9-25 
23-94 

2-15 
2.41 
1. 81 
4-74 
2-33 
6.24 

5.20 
4.80 

4.89 
14.89 

9-54 
24-43 

1.89 
2.12 
1 .60 

4-25 
2.30 
6.04 

5-31 

4-84 

4.67 

14.82 

9-45 
24.27 

1.99 
2.22 
1.70 

4-41 
2.31 
6. II 

ation  period,  a  series  of  seven  questions 
are  asked.  These  require  specific  infor- 
mation about  the  story,  and  the  answers 
must  be  perfect.  The  total  score  is  a  total 
of  credits  received  for  the  free  association 
and  the  direct  questioning. 

This  type  of  memory  item  was  chosen 
for  the  following  reasons;  (1)  it  is  a  test 
of  memory  for  meaningful  material.  (2) 
It  gives  the  clinician  a  glimpse  of  the 
patient's  ability  to  organize  this  type  of 
material  into  a  unified,  integrated  whole. 
There  is  a  definite  possibility  for  analysis 
from  this  viewpoint;  i.e.,  are  the  "memo- 
ries" disorganized  and  given  in  a  random 
order  or  is  the  organization  factor  so 
compelling  that  only  the  bare  outlines 
are  given  and  the  details  ignoretK"  (^) 
Much  rich  data  may  be  obtained  from 
this  type  of  test.  Ihe  associations  that  are 
aroused  may  be  definite  therapeutic 
leads.  It  has  occasionally  hapjiened  that 
the  patient's  reproduction  has  given  a 
definite  clue  as  to  the  cause  of  his  affec- 
tive disorder.  The  test  also  has  been 
found   to   be   fairlv   sensitive   to   certain 


tively.  In  discussing  each  of  the  sub-tests 
the  quantitative  aspect  will  be  considered 
first. 

The  data  obtained  from  the  memory 
test  has  been  subdivided  in  such  a  man- 
ner that  the  results  from  the  free  associ- 
ation and  the  tpiestions  have  been 
considered  separately  as  well  as  in  combi- 
nation (total  score).  In  Table  10  the  dis- 
tribution constants  for  each  group  are 
given.  As  is  indicated,  the  free  association 
data  has  been  divided  into  thirds.  This 
was  done  to  determine  whether  such 
factors  as  primacy  and  recency  operated 
in  the  same  manner  for  each  of  three 
groups.  It  is  apparent  that  more  was  re- 
tained of  the  first  and  final  thirds  than  of 
the  intervening  section.  This  held  for 
all  three  groujjs  and  the  ratio  in  each 
case  was  virtually  identical.  It  may  be 
well  to  point  out  that  although  the  mean 
of  the  final  tliird  of  each  group  was  ap- 
proximately the  same  as  that  for  the 
middle  section,  it  contained  one  less 
"memory  "  than  either  the  first  or  second 
subdivision.  It  was  prorated  on  this  basis 
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and  the  resultant  mean  was  found  to 
be  higher  than  that  for  the  middle  sec- 
tion. 

The  percentage  of  the  brain  injured 
and  control  patients  correctly  answering 


for  comparative  purposes.  As  is  indicated 
by  the  control-brain  injured  group  com- 
parison, the  obtained  variance  was  highly 
significant  from  a  quantitative  stand- 
point.    However,     when     dealing    with 


Tablk  II 

Percentage  of  the  brain  injured  and  control  patients 
answering  the  questions  correctly 


Brain 

Injured 

Controls 

Diff. 

D/S.D. 

yuesuons 

N 

% 

N 

% 

Diff. 

I 

19 

43 

32 

63 

20 

1.98 

2 

38 

86 

51 

100 

14 

2.6q 

3 

^5 

57 

40 

78 

21 

2.21 

4 

1 1 

25 

33 

65 

40 

4.26 

S 

1 1 

25 

21 

41 

16 

1.68 

6 

8 

18 

14 

27 

9 

I  .06 

7 

34 

77 

51 

100 

23 

3.65 

each  of  the  seven  questions  is  given  in  groups   as   small   as   have   been   used   in 

Table  1 1.  The  percentage  differences  ob-  this  study   it   is  necessary   to  determine 

tained    consistently    favor    the    controls  whether  the  means  that  have  been  ob- 

and  are  either  clearly  significant  or  indi-  tained  are  good  measures  of  central  ten- 

cate  definite   trends  in  all  but  two   in-  dency.   That  is,   it  is   possible   that   the 

Table  12 
Significance  of  mean  differences 


^ 

eurotics  vs. 

Controls 

vs. 

Normals 

Brain 

Inj 

ured 

Diff. 

"t" 

Diff. 

"t" 

ist  5  Free  Association 

■36 

■59 

1.65 

4.00 

2nd  1  Free  Association 

•  14 

.  20 

1-93 

4.14 

3rd  ^  Free  Association 

•  70 

1.36 

I. 71 

4.58 

Total  Free  Association 

.  20 

•15 

5-30 

5-53 

Questions 

.29 

•  41 

2-59 

4.38 

Total  Memory  Score 

•49 

.26 

7.89 

5-48 

stances.  In  these  cases  the  questions  are 
evidently  too  difficult  to  be  discrimina- 
tory. 

Significance  of  the  mean  differences 
was  computed  and  the  results  are  given 
in  Table  12.  The  neurotics  and  normals 
do  not  appear  to  differ  in  any  respect. 
Although  this  was  suggested  by  their 
means,  it  was  considered  best  to  make 
this  test  before  the  two  groups  were  com 
bined  into  the  control  group  and  used 


averages  have  been  affected  by  the  pres- 
ence of  a  few  extremely  low  or  high 
scores.  To  check  this  possibility  the  total 
memory  test  raw  scores  were  plotted  and 
the  results  are  shown  giaphically  in 
Figure  1.  Unquestionably  a  bimodal 
curve  has  resulted  and  in  general  the 
scores  appear  to  be  well  distributed  in 
each  of  the  two  groups. 

One  other  fact  of  interest  can  be  read- 
ily derived  from  the  graph.  A  ninnber  of 
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the  brain  injured  patients  obtained  scores 
near  or  above  the  average  of  the  control 
group  and  the  converse  situation  is  also 
true.  It  is  apparent  that  given  a  total 
test  score  it  would  be  impossible  to 
classify  every  patient  as  brain  injured  or 
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scores.  Upon  first  consideration,  a  zero 
score  would  seem  to  be  nearly  impt^ssible 
provided  the  subject  was  making  an  ef- 
fort. However,  the  examiner  had  known 
these  patients  for  a  considerable  period 
of  time  prior  to  testing,  and  excellent 
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Fic.   I.  Graphic  distribution  of  total  niemor)'  raw  scores  for  the  brain  injured  and  control  groups. 

Key:  Solid  Columns  =  Controls 


not  brain  injured  with  a  satisfactory  de- 
gree of  certainty. 

Qualitatively  the  test  was  productive. 
Four  of  the  brain  injured  cases  during 
the  free  association  period  gave  stories 
that  bore  little  relationship  to  the  one 
that  was  read  to  them.  However,  they 
retained  enough  of  the  original  story  to 
receive  some  credit.  In  every  instance 
the  confabulation  had  a  central  idea  or 
theme  and  was  fairly  coherent  and  co- 
hesive, but  in  each  instance  elements  of 
circumstantiality,  preservation,  and 
pseudo-profundity  were  present.  When 
asked  the  series  of  questions,  three  pa- 
tients became  indignant  and  asked  how 
they  were  expected  to  answer  questions 
about  something  that  had  not  been  read 
to  them.  A  fourth  person  gave  answers 
to  each  question,  none  of  which  were 
related  to  either  the  original  story  or  his 
version  of  it.  Three  others  received  zero 


rapport  had  been  established.  None  of 
them  were  excessively  concerned  over 
their  failure,  having  previously  experi- 
enced such  lapses  of  memory  since  their 
injury.  After  inquiry  it  was  found  that 
other  patients  had  noted  their  difficulty, 
especially  in  connection  with  radio  pro- 
grams. If  a  play  or  a  dramatized  current 
event  were  being  presented,  these  pa- 
tients would  forget  characters  and  also 
events  that  had  occurred  earlier  in  the 
program.  They  often  became  hopelessly 
confused  and  continually  asked  others 
for  information  about  what  had  previ- 
ously happened,  or  who  a  character  was 
and  how  they  were  connected  with  the 
story.  At  the  other  extreme,  three  of  the 
brain  injured  patients  obtaining  the 
highest  scores  did  not  confine  their  efforts 
to  repeating  the  content  of  the  original 
story  but  embellished  it  to  the  point  of 
giving  a  partial  life  history  of  every  char- 
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acter  involved,  what  occurred  before  the 
story  started  and  what  happened  alter 
its  completion.  Other  brain  injured  pa- 
tients exhibited  a  condition  which  ap- 
proximated impoverished  thinking  or 
brevity  of  associations.  Their  reproduc- 
tions were  the  bare  essentials.  However, 
a  stnprising  number  of  scoreable  answers 
were  often  given  if  the  patients  were  en- 
couraged. 

Finally  it  was  found  that  if  a  few  hints 
were  given  after  the  questions  had  been 
asked  and  scored,  the  majority  of  the 
controls  were  able  to  increase  their  origi- 
nal score  considerabh.  However,  when 
the  brain  injured  group  was  allowed  the 
same  aids  very  little  improvement  re- 
sulted. 

The  use  of  this  type  of  memory  test 
has  demonstarted  the  existence  of  certain 
qualitative  behavioral  differences  as  well 
as  a  highly  significant  quantitative  inter- 
group  score  variance.  The  degree  to 
which  the  former  is  characteristic  of 
brain  damage  and  the  validity  of  the 
latter  will  be  discussed  later  in  the  pa- 
per. 

//.  Trail  Making  Test 

The  second  sub-test  has  two  parts  (A 
and  B).  Part  A  consists  of  a  sheet  of  paper 
on  which  there  is  printed  a  series  of 
circles.  In  the  center  of  each  of  these  is 
a  number,  with  a  range  for  the  test 
proper  from  1-25,  and  for  the  sample 
which  is  on  the  opposite  side  of  the  page, 
from  1-7.  These  circles  are  spatially  ar- 
ranged in  a  random  order.  The  patient 
is  given  a  pencil  and  the  test  is  placed, 
sample  side  up,  in  front  of  him.  The 
examiner  then  tells  the  subject  that  his 
task  \m'\\\  be  to  draw  a  line  from  1  to  2, 
from  2  to  3,  from  3  to  4  and  so  on,  in 
order,  until  the  end  is  reached.  Each 
numbered  circle  is  pointed  out  as  it  is 
referred  to,  but  an  imaginary  line  from 


point  to  point  should  not  be  traced  with 
either  a  finger  or  pencil.  The  subject 
then  performs  the  task  for  the  sample, 
which  gives  ample  indication  of  whether 
or  not  the  directions  have  been  compre- 
hended. J  "he  paper  is  then  turned  over 
and  the  previously  given  directions  re- 
peated. The  patient  is  told  that  the  test 
is  to  be  completed  as  rapidly  as  possible. 
He  is  cautioned  that  if  a  mistake  is  made 
to  cross  it  out  or  erase  it  as  rapidly  as 
possible  and  keep  on  going. 

Part  B  is  similar  in  structure  to  Part 
A,  but  there  is  a  definite  difference  inas- 
much as  the  test  and  sample  have  both 
numbered  and  lettered  circles  presented 
in  a  random  order.  Following  the  proced- 
ure outlined  above  the  directions  given 
for  a  sample  and  test  proper  are  as  fol- 
lows;—Draw  a  line  from  1  to  A,  from 
A  to  2,  from  2  to  B,  B  to  3,  etc.  The  ex- 
aminer carefully  indicates  the  sequence 
of  ninnber-letter,  number-letter  to  the 
patient.  Again  care  is  taken  to  point  to 
each  circle  but  not  to  trace  a  line  with  a 
finger  or  pencil.  After  the  sample  has 
been  satisfactorily  completed,  the  page 
is  turned  over.  The  directions  are  re- 
peated, and  the  patient  is  told  to  work 
as  rapidly  as  possible  and  if  any  error  is 
made  to  cross  it  out  or  erase  it  as  quickly 
as  possible  and  to  continue. 

When  administering  the  Army  Individ- 
ual Test  the  examiner  removed  either 
part  of  this  test  when  the  patient,  after 
making  an  error,  does  not  notice  and 
correct  it  before  he  has  proceeded  beyond 
three  more  circles  (4).  This  procedure 
has  been  altered.  As  the  item  in  this  in- 
stance is  being  used  to  study  the  effects 
of  brain  injury,  all  possible  behavioral 
data  was  collected.  In  every  case  the  pa- 
tient was  allowed  to  complete  the  test.  It 
was  of  interest,  for  example,  to  see  how 
often  the  sequence  in  Part  B  of  number- 
letter  would  be  lost.  Therefore  after  the 
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test  had  been  failed  according  to  the  cri-  ever,    there   may    be   a   carry-over   effect 

terion  above,  the  patient  was  encouraged  from  Part  A,  which  required  only  a  num- 

and    the   number-letter   relationship    re-  ber  to  number  sequence.  If  the  subject  is 

established.  It  was  also  felt  that  rcniov-  rigid,   perseverative,  or  unable  to  shift, 


Table  13 

Distribution  constants  obtained  in  quantitative  analysis 
of  the  trail  making  test 


Brain  Injured 

Neurotics 

Normals 

Total  Control 

M 

S.D. 

M 

S.D. 

M 

S.D. 

M 

S.D. 

Trail  Making  A 

Trail  Making  B 

Total  Score 

6.93 
1.86 
8.80 

3.  26 
2.08 
4.66 

9-56 

5-56 

15-13 

•79 
2.50 

2.85 

9.86 

6.03 

15.89 

.68 

2-75 
2.97 

9.76 

5.88 

15-65 

-73 
2.68 
2.96 

ing  the  test  increased  sense  of  failure  and 
inadequacy,  which  in  our  opinion, 
shoidd  be  avoided. 

The  test  w^as  selected  because  it  seemed 
to  measure  the  following  functions:   (1) 


it  is  easy  to  envision  the  difficidty  that 
will  be  involved.  However,  after  failure 
on  Part  B,  it  is  necessary  to  determine 
whether  or  not  the  subject  actually  knows 
the  sequence  of  letters  in  the  alphabet 


Table  14 
Significance  of  mean  differences 


Normals  vs 
Neurotics 

Con 
Brain 

trols  vs. 
Injured 

Diff. 

it^ti 

Diff. 

"t" 

Trail  Making  A 
Trail  Making  B 
Total  Score 

•30 
•47 
•76 

1-34 
•57 
.84 

2.83 
4.02 
6.85 

5-99 
8.00 
8.62 

Ability  to  perceive  a  double  relationship, 
(2)  Ability  to  plan,  (3)  Ability  to  "shift", 
and  (4)  Related  to  the  preceding  point, 
the  presence  of  any  perseverative  tcnd- 
encv. 

In  order  to  do  well  (jn  the  test  it  is 
necessary  always  to  look  ahead,  and  be- 
fore the  test  is  started,  to  form  a  cjuick 
over-all  plan.  The  subject  who  draws  a 
line  from  i  to  2,  on  reaching  2  begins 
looking  for  3.  and  repeats  this  procedure 
over  and  over  will  do  rather  poorly  be- 
cause of  the  time  factor. 

In  part  R  the  subject  nuist  completely 
understand  the  nundicr-lctter  relation- 
ship   for   successful    performance.    How- 


in  order  to  rule  out  failure  on  this  basis. 
The  scoring  is  simple.  Each  part  is 
e\aluated  from  the  standpoint  of  time 
and  accuracy.  If  no  errors  are  made,  or  an 
error  is  corrected  very  quickly,  the  score 
oI)iained  depends  directly  on  the  speed 
with  which  the  test  was  completed.  If 
thr  item  is  accomplished  in  less  than  20 
seconds  a  maximum  score  of  10  is  given; 
Iiowever,  if  longer  times  are  taken  partial 
credits  are  given,  depending  upon  the 
rapidity  of  completion.  Zero  scores  are 
awarded   onlv   when    uncorrected   errors 

J 

arc  committed. 

-As  is  indicated  bv  the  distribution  con- 
stants  in  Table  13  a  marked  variance  ex- 
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istcd  between  the  controls  and  the  brain  usually    able    to    rccogni/e    and    correct 

injured  groups.  As  a  matter  of  interest,  them   quickly-   In  reference  to  this  last 

the  mean  score  for  the  controls  on  the  point  it  should  be  made  clear  that  on 

Trail  Making  A  alone,  exceeds  the  mean  Trail  making  A  and  R  only  two  of  the 

total   score   (Trail   Making   A   R:   B)   ob-  brain  injured  cases  ever  realized  that  an 

Table  15 
Number  and  per  cent  of  subjects  making  and  correcting  errors 


Trai 

1  Mak 
A 

ng 

Trail  Mak 
B 

ng 

Groups 

Ei 

Tors 

Errors 
Corrected 

Errors 

Errors 
Corrected 

N 

% 

N 

% 

N 

% 

N             % 

Brain  Injured 
Neurotics 
Normals 
Total  Controls 

12 

3 
2 

5 

27 

19 

6 

10 

7 
3 
2 

5 

5  8 
100 
100 
100 

25 

4 
10 

14 

57 
25 

20 
27 

7            28 
4           100 

7              70 
II              79 

tained  by  the  brain  damaged  cases.  The 
degree  to  which  these  differences  are  to 
be  considered  significant  is  presented  in 
Table  14.  The  raw  scores  have  been  plot- 
ted for  parts  A  and  B  as  well  as  the  total. 
In  each  case  (Figures  2,  3,  and  4)  definite 
bi-modality  has  resulted  and  the  means 
do  not  appear  to  have  been  unduly  in- 
fluenced by  the  presence  of  extreme 
scores. 

It  was  considered  of  interest  to  com- 
pute the  number  of  errors  committed  and 
from  this  data  determine  the  percentage 
of  cases  in  each  group  that  were  able  to 
recognize  and  correct  their  errors  before 
failure  occurred.  The  appropriate  results 
are  given  in  Table  15. 

Considering  the  Trail  making  A  first, 
the  percentage  difference  in  respect  to 
the  total  number  of  errors  made  did  not 
reflect  a  significant  variance,  but  the  per- 
centage of  the  two  groups  that  were  able 
to  correct  their  errors  did.  As  for  the 
Trail  making  B  both  aspects  considered 
above  yielded  significant  differences.  In 
general,  the  controls  tend  to  make  less 
errors,    but    more    irnportant,    they    are 


error  had  been  committed.  Their  errone- 
ous test  performance  seemed  completely 
adequate  to  them.  Finally  four  of  the 
five  errors  that  the  controls  made  on 
Trail  making  A  were  caused  by  the  omis- 
sion of  circle  number  24.  That  is,  in  their 
haste  to  finish  the  test,  they  would  draw 
a  line  directly  from  23  to  25.  None  of 
the  errors  made  by  the  brain  damaged 
patients  were  of  this  nature. 

The  number  of  errors  that  were  com- 
mitted on  the  sample  of  both  parts  of  the 
test  were  determined  but  these  were 
evenly  distributed. 

The  comparative  performance  of  the 
two  groups  was  very  interesting.  Un- 
questionably the  outstanding  reason  for 
the  low  mean  of  the  brain  injured  group 
on  Part  A  was  their  lack  of  planning 
and  anticipation.  Most  of  the  control 
cases  would  look  at  the  test  to  get  some 
over-all  idea  of  the  position  of  the  circles 
and  their  inter-relationship  before  the 
test  was  started.  In  addition  they  would 
constantly  look  ahead  so  that  while  draw- 
ing a  line  between  any  two  numbers  they 
would   be   locating   the  next   in   the  se- 
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quence.  This  we  believe  is  similar  to  the 
anticipation  and  planning  aspect  neces- 
sary for  excellent  performance  with  the 
Object  Assembly  sub-test  of  the  W-B.  If 
the  whole  is  recognized  in  terms  of  its 
parts  and  integrated  before  actual  mani- 
pulation has  begun,  the  object  will  be  as- 


correct   circle    and    continue    from    that 
point. 

Trail  making  (B)  definitely  introduces 
a  dual  relationship.  Most  of  the  errors 
made  by  both  groups  can  be  attributed 
to  the  failure  to  adequately  deal  with 
a  two  aspect  problem.  There  is  consider- 
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Fig.  2.  Graphic  distribution  of  the 

trail  making  (A)  raw  scores.  Key: 

Solid  Columns  =z  Controls. 

sembled  more  rapidly  than  if  a  haphaz- 
ard approach  is  made.  ^Ve  have  chosen 
to  call  this  behavior  "planning  ahead" 
and  it  is  probably  an  aspect  that  might 
well  be  included  under  the  general  head- 
ing of  anticipation.  The  brain  damaged 
patients  on  the  other  hand,  would  im- 
mediately start  drawing  a  line  from  one 
to  two.  At  this  point  they  would  stop  and 
search  for  three.  This  method  would  be 
repeated  over  and  over  until  the  test  was 
completed.  This  failure  to  "i>Ian  ahead" 
seemed  to  be  responsible  for  go*^'^  of  the 
errors  that  they  made.  When  they  would 
stop  to  look  for  the  next  number  they 
would  use  the  pencil  as  a  pointer.  After 
the  correct  number  had  been  located, 
they  would  often  cither  begin  again  from 
the   located   circle   or   return    to   an   in- 


FiG.  3.  Graphic  distribution  of  the 

trail  making  (B)  raw  scores.  Key: 

Solid  Columns  ^  Controls. 

able  evidence  that  rigidity  and  persevera- 
tion are  characteristic  of  the  brain  dam- 
aged patient.  With  this  in  mind  it  would 
seem  that  the  number-number  sequence 
of  the  Trail  making  A  should  have  con- 
siderable effect  on  the  performance  of 
Trail  making  B.  However,  failures  due 
to  a  letter  to  letter  sequence  occurred  as 
often  as  number  to  number  failures. 
Most  of  the  brain  injured  cases  who  did 
correctly  complete  the  test,  did  so  very 
slowly.  They  constantly  repeated  aloud 
the  formula  "number-letter"  as  they 
worked.  The  examiners  noticed  this  in 
almost  all  of  those  that  did  succeed  in 
addition  to  those  who  became  confused. 
In  spite  of  this  constant  reminder  most 
of  them  lost  the  relationship  before  the 
test  was  completed.  In  these  instances 
they  would  retrace  part  of  the  record  or 
start  again  from  the  beginning. 
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\\  lull  iliscussing  the  ;ulininis(i  ation  ol 
the  test  it  was  pointed  out  that  tlie  e\- 
aniitier  alwavs  permitted  each  part  to  be 
completed  rather  than  to  withdraw  the 
test  after  an  error  hatl  been  made.  This 
was  done  for  two  reasons  (i)  to  prevent 
feelings  of  failnre  and  (2)  determine  the 
number  of  times  the  number-letter  rela- 
tionship  would   be   lost  before  the  test 
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Fig.  4.  Graphic  distribution  of  total 

trail   making  raw  scores.  Key: 

Solid  Columns  =  Controls. 

was  completed.  It  was  found  that  those 
who  failed  averaged  three  errors,  in  addi- 
tion to  the  original,  before  the  test  was 
finished.  Some  never  were  able  to  retain 
the  sequence  over  two  or  three  circles. 
These  had  to  be  constantly  prompted.  A 
very  few  did  not  make  further  errors  but 
worked  so  slowly  that  if  no  error  had 
been  made  at  all  their  score  would  have 
been  one  instead  of  zero.  Each  of  the 
controls  making  errors  was  able  to  com- 
plete the  test  without  further  difficulty. 

///.  Patch  Test 

The  third  item  requires  the  duplica- 
tion of  nine  colored,  circular  patterns 
which  resemble  shoulder  patches  worn 
on  the  Army  uniform.  One  of  the  nine 
serves  as  a  demonstration  item  and  the 
other  eight  compose  the  test  proper.  The 
materials   necessary  for   the  duplication 


consists  of  nineteen  j^aper  circles  of  dif- 
ferent colors.  Some  of  these  are  solid 
while  others  have  different  sections  of  the 
interior  part  removed  so  that  by  placing 
them  one  on  top  of  another,  a  pattern 
may  be  formed. 

The    test    materials    are    arranged    in 
front  of  the  patient  in  a  standard  order. 
1  his  is  facilitated  as  each  circle  is  num- 
bered. After  the  test  materials  have  been 
properly   placed,   the   examiner  exposes 
the  demonstration  patch.   It   is  pointed 
out  that  the  design  resembles  a  shoulder 
patch  and  that  it  can  be  made  by  putting 
together  some  of  the   circular  cards   in 
front  of  the  subject.  The  examiner  then 
demonstrates   the  correct  solution.  The 
pieces  are  then  returned  to  their  proper 
places  and  the  patient  is  asked  to  dupli- 
cate the  same  design.  Following  this  the 
subject  is  told  that  other  patches  will  be 
exposed  and  it  will  be  his  task  to  correct- 
ly duplicate  each  of  them.  He  is  told  that 
his  solution  must  have  exactly  the  same 
shape  and  color  as  the  test  patch  that  has 
been  exhibited  and  that  he  may  use  as 
many  of  the  circular  pieces  as  necessary. 
The  first  test  patch  is  then  turned  up. 
Ample  time  is  allowed  for  construction 
and  added  time  credit  is  given  if  the  de- 
sign is  completed  quickly.  The  eight  test 
designs  are  in  graded  order  of  difficulty. 
The  first  one  is  extremely  easy  and  al- 
though it  adds  absolutely  nothing,  in  a 
statistical   sense,    to   the   validity   of  the 
item,    it    is    invaluable   as   a   confidence 
builder.  Each  patient  can  see  the  results, 
is  aware  that  he  has  completed  the  first 
task  correctly  and  through  success  devel- 
ops enthusiasm  for  the  test. 

The  test  is  terminated  after  two  fail- 
ures regardless  of  whether  or  not  they 
occur  successively.  However,  we  have  not 
withdrawn  the  test  patch  when  the  al- 
lowed time  limit  has  been  reached  and 
the  design  has  not  been  reproduced.  In- 
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Stead  the  examiner  has  given  minor  sug- 
gestions leading  to  the  correct  solution. 
The  actual  number  of  designs  available 
for  duplication  is  never  mentioned,  so 
that  the  final  failure  always  occurs  on  the 
"last"  design  in  the  series.  The  scoring  is 
on  the  basis  of  accuracy  and  time,  al- 
though for  observational  purposes  and 
to  escape  a  feeling  of  frustration  or  dis- 
appointment on  the  part  of  the  patient, 
he  is  actually  allowed  as  much  time  as  he 
needs.  The  test  was  included  as  it  seemed 
to  provide  a  means  of  sampling:  (i) 
analysis  and  synthesis;  (2)  ability  to  shift; 
(3)  ability  to  stick  to  a  point,  and  (4) 
possible  perseverative  trends.  To  what 
extent  each  of  these  abilities  enter  into 
the  final  soliuion  cannot  be  determined. 
Obviously,  the  basic  abilities  will  be 
those  of  analysis  and  synthesis.  However, 
the  assembly  of  certain  of  these  patterns 
is  much  more  complicated  than  the 
Wechsler-Bellevue  Block  Design  Test.  It 
must  be  remembered  that  these  patterns 
are  being  built  up  in  depth  and  that  in 
placing  pieces  one  on  top  of  another, 
parts  are  being  blocked  out.  This  means 
that  the  design,  though  rather  simple 
to  break  down,  must  be  assembled  in 
terms  of  parts  of  the  nineteen  circular 
pieces  and  these  sections  of  the  whole 
discs  may  be  far  from  apparent.  This  is 
illustrated  by  Figure  5.  Although  the 
bottom  pattern  is  not  a  true  test  design 
it  will  serve  to  make  clear  the  difficulty 
involved.  In  the  actual  test  situation  each 
design,  with  one  exception,  can  be  dupli- 
cated only  by  putting  together  specific 
discs  of  the  19  provided.  These  must  be 
chosen  from  a  number  whose  characteris- 
tics are  similar  to  the  parts  of  the  actual 
test  patch.  Although  most  of  the  j^atterns 
are  simple  to  analyze,  a  few  are  very 
difficult.  The  difficulty  consists  largely 
in  determining  what  is  figure  and  what  is 
ground.  If  the  subject  starts  with  an  as- 


sumption that  is  incorrect  and  has  lost 
the  ability  to  "shift",  failure  usually  fol- 
lows. Some  designs  are  more  easily  solved 
if  the  patient  begins  by  selecting  the  top 
piece;  others  are  assembled  more  easily 


Fk..  5.  Illustration  ol  a  patch  assembly. 

from  the  bottom  uj).  If  the  same  ap- 
proach is  employed  in  every  case,  it 
creates  an  added  hardship.  The  aspects 
and  functions  necessary  for  success  will 
be  discussed  in  greater  detail  when  con- 
sidering the  brain  injured  patients'  per- 
formance. 

The  distribution  constants  and  signi- 
ficance of  mean  differences  are  presented 
in  Table  16.  A  highly  significant  variance 
was  found  to  exist  between  the  control 
and  brain  injured  groups.  This  being 
true  it  was  of  interest  to  determine 
whether  any  one  or  two  of  the  designs 
were  responsible  for  the  poorer  scores 
obtained  by  the  brain  damaged  patients. 
The    percentage    distribution    of    each 
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group  successfully  assenibliui;  the  indi- 
\iclual  designs  is  shown  in  Table  17. 
The  results  suggest  that  the  patterns  were 
arranged  in  order  of  difficulty  and  each 


As  a  further  investigation  the  distribu- 
tion constants  and  significance  of  mean 
(lilferences  were  computed  for  tlie  actual 
time  taken  to  assemble  the  patterns.  With 


Table  16 
DisU-ibution  constants  and  significance  of  mean  differences 


Test 

Brain  Injured 

Neurotics 

Normals 

Total  Controls 

M            S.D. 

M            S.D. 

M           S.D. 

M            S.D. 

Patch 
Difference 

10.28         6.13 

Neurotics 

vs. 

26 

20 

1 7 . 00         4 . 46 
Normals. 

16.74        4.08 
Controls 

vs. 
6 
6 

16.82         4.20 
Brain  Injured 

55 
04 

of  them  appears  to  have  contributed  pro- 
portionally to  the  lower  mean  of  the 
brain  injined  group.  Evidently  the  first 
and  last  two  patches  add  little  to  the 
test's  ability  to  discriminate  between  the 


the  exception  of  the  first  design  no  sig- 
nificant differences  were  found.  These 
residts  are  similar  to  those  that  were  de- 
termined in  an  earlier  study  of  the  MAS 
(1).  Both  the  Patch  and  the  Block  Designs 


Table  17 
Percentage  of  the  groups  correctly  assembling  each  patch 


Patches 

Brain 

N 

Injured 

0/0 

Controls 

Difference 

D/SD 

N 

0/0 

Diff. 

I 
2 

40 
30 

93 
70 

51 
5° 

100 
98 

7 
28 

1 .84 
3-84 

3 

28 

6S 

47 

92 

27 

3-29 

4 
5 
6 

25 
17 
13 

58 
40 
30 

47 
39 
33 

92 
76 
6S 

34 
36 
35 

4-05 
3-76 
3-65 

7 
8 

10 
3 

23 

7 

29 
9 

57 
18 

34 
II 

3.62 

1.67 

9 

I 

2 

8 

16 

14 

2.50 

two  gioups.  The  first  is  much  too  easy 
and  the  last  two  are  too  difficult. 

A  final  quantitative  check  was  made  to 
determine  whether  the  controls  and 
brain  injured  cases  who  were  able  to 
correctly  construct  the  designs,  differed 
in  relation  to  the  speed  with  which  they 
were  able  to  assemble  the  patterns.  With 
the  exception  of  the  first  design,  the  re- 
sults indicate  (Table -18)  that  if  the  brain 
injured  patient  is  able  to  duplicate  the 
pattern,  he  does  it  quickly  enough  to  ob- 
tain as  much  time  credit  as  do  controls. 


tests  seem  to  operate  according  to  an  "all 
or  nothing"  principle.  That  is,  either  the 
designs  or  patches  are  solved  with  normal 
speed  and  accuracy,  or  they  are  not  solved 
at  all. 

Continuing  the  same  procedure  as  was 
established  in  the  treatment  of  the  mem- 
ory data,  the  raw  scores  of  the  patch  test 
were  plotted  for  both  groups.  Again  a 
bimodal  curve  resulted  (Figure  6).  How- 
ever, as  was  found  before,  a  number  of 
brain  damaged  cases  obtained  scores  near 
or  above  the  mean  of  the  controls  and 
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vice  versa.  The  scores  of  both  groups  ap-  differences  are,  however,  a  matter  of  de- 
pear  to  be  well  distributed  and  it  does  gree  rather  than  an  attribute  of  any 
not  seem  that  the  means  have  been  un-  group. 

duly  affected  by  the  presence  of  a  number  The  second  qualitative  observation  was 

of  extreme  scores.  the  relative  inability  of  the  brain  dam- 

Table  1 8 
Percentage  of  both  groups  obtaining  time  credit 


Brain 

Injured 

Cor 

itrols 

T3q  tcVkCtfi 

Difference 

D/SDdiff 

N 

0/0 

N 

0/0 

I 

31 

78 

51 

100 

22 

3-39 

2 

22 

73 

44 

82 

9 

.09 

3 

16 

57 

36 

77 

20 

1.79 

4 

19 

76 

41 

87 

II 

103 

5 

10 

59 

22 

S6 

3 

.  21 

6 

7 

54 

17 

52 

2 

.  12 

7 

4 

40 

IS 

52 

12 

.66 

8 

2 

67 

2 

22 

9 

I 

100 

3 

38 

Qualitatively,  a  number  of  definite  dif- 
ferences between  the  groups  were  no- 
ticed. Time  and  time  again  the  brain  in- 
jured patients  would  begin  by  selecting 
a  number  of  pieces  which  would  be  ar- 
ranged in  a  \ariety  of  ways;  these  would 
be  discarded  and  others  selected,  but  al- 
most immediately  they  would  return  to 
the  ones  they  had  chosen  originally  and 
proceed  to  arrange  and  re-arrange  them 
as  had  been  done  before.  This  entire 
procedure  would  often  be  re-enacted  un- 
til the  time  limit  had  been  exceeded. 
This  inability  to  shift  not  only  operated 
in  the  manner  outlined  above  but  ex- 
tended to  the  inability  to  rearrange  pieces 
and  rigidity  in  approach  (persistently 
starting  from  top  or  bottom  regardless  of 
success  achieved)  from  design  to  design. 
This  perseverative  and  rigid  behavior 
was  also  noticed  in  a  number  of  the  con- 
trol (ases.  However,  the  controls  could 
and  did  alter  the  order  of  the  cards, 
select  new  pieces,  and  if  the  pattern  was 
not  readily  assembled  in  starting  from 
the  top,  they  would  try  it  from  the  bot- 
tom. In  general  it  is  stiggested  that  these 


aged  patients  to  deal  effectively  with  a 
dual  relationship.  The  completed  assem- 
bly must  have  the  same  form  and  color 
as  the  original  to  receive  credit.  Very  fre- 
quently the  form  would  be  correctly  du- 
plicated but  the  color  wotild  be  disre- 
garded. On  the  other  hand,  the  colors, 
might  be  the  chief  concern  and  the  form 
wotdd  be  ignored. 

Third  was  the  lack  of  plan.  The  brain 
damaged  patient  showed  less  of  an  inte- 
grated or  unified  approach.  A  definite 
plan  or  method  was  obvious  occasionally, 
but  it  was  so  nebulous  that  when  the 
slightest  difficulty  was  encountered  the 
entire  approach  often  disintegrated. 

Fourth  was  the  brain  injured  patients' 
seeming  inability  to  analyze  the  pattern 
to  be  duplicated.  A  number  of  the  pa- 
tients would  look  at  a  design  and  say, 
"red  is  the  bottom",  and  pick  up  a  red 
piece  when  actually  a  yellow  one  was 
needed.  The  fifth  was  the  inability  to 
synthesize.  In  these  instances  the  patients 
would  make  the  correct  assumptions  but 
woidd  be  unable  to  select  certain  cards 
having  parts  necessary  for  successful  com- 
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jjlction.  Usually  a  j)artially  correct  solu- 
tion would  be  olicncl  in  these  cases. 

The  sixth  was  a  dnal  lador.  Some  of 
the  brain  injinecl  cases  arrived  at  the 
correct  solution,  but  they  worked  so  slow- 
ly that  they  failed  to  receive  cledit.  Fail- 
ure was  due  directly  to  slowness  in  trying 
the  various  pieces.  On  the  other  hand,  a 


RAW  SCORES 

Fir..  6.  Graphic  distriliiition  of 

patch    test   raw   scores.   Key: 

Solid  Columns  ==  Controls. 

number  worked  so  quickly  that  they 
would  correctly  assemble  a  design  and 
then  tear  it  down  before  they  realized 
that  they  had  correctly  duplicated  the 
patch.  This  behavior  was  also  occasional- 
ly noticed  among  the  controls,  especially 
in  the  neurotic  group. 

Finally,  there  was  the  effect  of  help 
or  the  factor  of  learning.  If  one  of  the 
patches  early  in  the  series  was  failed,  the 
examiner  demonstrated  the  correct  as- 
sembly. Most  of  the  controls  were  greatly 
aided  and  applied  the  observed  tech- 
niques to  the  next  design.  The  brain 
damaged  patient  on  the  other  hand,  rare- 
ly gained  anything  from  watching  a  pat- 
tern duplicated. 

The  types  of  behavior  just  described 
are  neither  arranged  in  order  of  fre- 
quency or  importance.  Obviously  these 
are  not  all  the  behavioral  variances  that 


occurred,  bin  ihey  are  the  ones  that  were 
observed  most  often".  It  was  quite  clear 
to  the  examiners  that  none  of  the  factors 
described  above  was  the  sole  cause  for 
faihne.  \\\q  extent  to  which  each  may 
have  been  res])onsible  is  a  subjective  con- 
sideration and  any  assumptions  that 
might  be  made  would  in  all  probability 
be  misleading  and  inaccurate  to  some  ex- 
tent. 

U\  The  Goldstein-Scheerer  Cube  Test 

The  fourth  sub-test  we  have  used  in 
our   screening   device   is    the   Goldstein- 
Scheerer   Cube   Test   (9).   The   material 
consists  of  four   one  inch,   varicolored, 
square,   wooden  blocks   and   a  series  of 
colored  designs,  adopted  from  those  de- 
veloped by  Kohs  (18).  The  procedure  in 
administration  is  familiar  to  every  clini- 
cian. After  placing  the  four  blocks  be- 
fore the  subject,  the  examiner  states  that 
they  are  all  alike,  i.e.,  on  one  side  they 
are  all  red,  another  side  all  blue,  another 
side  yellow  and  blue,  etc.  The  examiner 
must  be  sure  that  the  subject  understands 
that  each  block  is  like  every  other  one.  A 
design  is  then  placed  before  the  subject, 
and  he  is  asked  to  duplicate  the  design  us- 
ing all  four  blocks.  Thereafter  no  further 
instructions  or  aids  are  given  the  subject. 
Every  move,  block  placement,  and  evi- 
dence  of   trial    and   error   behavior   are 
recorded  as  completely  as  possible.  If  the 
design  has  not  been  satisfactorily  dupli- 
cated in  three  minutes,  the  design  is  re- 
moved.  The  examiner  says,   "Let's  put 
this  one  aside  and  try  another.  We  will 
return  to  this  one  later".  Because  brain 
injured   patients   frequently  show  overt 
manifestations  of  frustration  as  a  result 
of  failure,  it  is  wise  to  avoid  accentuation 
of  poor  performance.  After  the  series  of 
twelve    designs    have    been    attempted 
(Step  I),  the  next  step  is  used  if  necessary. 
In  Step  II  the  designs  are  the  same  size 
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as  the  blocks,  l)ut  arc  in  no  other  way 
clifTcrent  Irom  the  designs  used  in  Step 
I.  Only  the  designs  failed  in  Step  I  are 
repeated.  If  any  failures  occur,  Step  III 
is  presented.  In  this  step,  the  designs  are 
again  the  size  used  in  Step  I,  but  heavy 
black  lines  have  been  drawn  through  the 
pattern  to  indicate  the  exact  position  of 
each  of  the  four  blocks.  If  any  of  these 
are  beyond  the  subject's  capability,  Step 
IV  is  administered.  The  designs  in  this 
step  also  have  the  heavy  black  lines  to 
indicate  the  block  positions,  and  in  addi- 
tion are  the  size  of  the  actual  blocks. 
Failure  at  this  point  terminated  the  for- 
mal test  presentation  as  far  as  this  study 
was  concerned,  although  Goldstein  de- 
scribed a  further  step  of  having  the  sub- 
ject attempt  the  reproduction  of  a  pat- 
tern made  up  of  actual  blocks.  In  our 
cases  the  examiner  placed  one  block  in 
its  correct  position  upon  the  design,  and 
asked  the  subject  to  do  the  same  with  the 
remaining  blocks.  This  was  done  to  per- 
mit an  eventual  solution  and  thus  re- 
lieve the  subject's  sense  of  failure. 

This  item  has  been  included  in  the 
test  for  three  reasons:  (i)  Because  of  the 
intellectual  functions  tested.  Goldstein 
and  Scheerer  (9)  believe  that  in  general, 
success  depends  upon  the  ability  to  as- 
sume the  "abstract  attitude".  A  discus- 
sion of  this  term  appears  in  their  mono- 
graph. It  is  our  opinion  that  it  resolves 
ultimately  to  the  ability  to  analyze,  syn- 
thesize, anticipate,  plan  and  shift.  This 
last  function  is  extremely  important 
when  designs  number  7.  10,  11  and  12 
are  reached.  These  are  diamond  shaped 
rather  than  square.  The  subject  has  con- 
structed all  previous  patterns  at  a  180° 
angle.  The  presentation  of  the  diamond 
shaped  designs  necessitates  a  shift  or 
change  in  approach.  The  need  for  analy- 
sis or  synthesis  is  obvious  and  does  not 
require  explanation.  A  number  of  rea- 


sons for  failure  are  given  by  Goldstein 
and  Scheerer.  These  seemingly  overlap 
to  such  an  extent  that  direct  application 
becomes  difficult.  (2)  To  (heck  Gold- 
stein and  Scheerer's  statement,  "jiatients 
suffering  from  functional  disturbances  of 
the  brain  cortex  are  not  able  to  adopt 
the  specified  abstract  attitude  required 
in  this  test"  (9).  This  assumption  has 
been  contested  by  Halstead  (11)  who  has 
noted  that  patients  with  frontal  injury 
have  been  able  to  think  in  a  defmite  ab- 
stract manner.  (3)  To  attempt  to  deter- 
mine the  practicability  of  formulating  a 
method  of  scoring  to  enable  validity  de- 
termination. A  clinician  does  not  select 
tests  at  random.  They  are  chosen  be- 
cause they  are  known  to  tap  certain  func- 
tions and  fulfill  certain  diagnostic  needs. 
Reliabilities  and  validities  have  been  es- 
tablished to  determine  the  measure's 
limitations.  It  is  not  enough  to  describe 
behavior,  one  must  know  the  significance 
of  its  characteristics  and  the  frequency  of 
occurrence  in  similar  cases. 

The  basic  premise  of  this  paper  is  that 
it  is  necessary  and  valuable  to  observe 
the  brain  injured  person  as  an  integrated 
whole.  This  does  not  necessitate  disre- 
gard of  statistical  aid  in  understanding 
data  that  has  been  collected. 

The  first  approach  was  to  determine 
the  number  of  control  and  brain  injured 
cases  that  failed  each  of  the  four  steps. 
These  results  are  given  in  Table  19.  Most 
of  the  brain  injured  group  were  able  to 
adopt  the  necessary  "abstract  attitude" 
and  of  those  that  did  fail  Step  I  only  a 
few  were  unable  to  alter  their  behavior 
before  the  final  step  was  reached.  It  is  of 
interest  that  nearly  all  of  the  controls 
that  failed  the  first  step  did  not  re(]uire 
Step  II.  That  is,  they  recognized  their 
errors  and  upon  re-presentation  of  Step 
I  they  were  able  to  successfully  duplicate 
the  patterns.  Some  of  the  brain  injured 
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patients  were  also  able  to  do  this.  Indica- 
tions ^\•el•c  present  that  learning  did  take 
j)hue  in  both  gronps  bnt  to  a  diiFerent 
degree.  The  foregoing  did  not  apply  to 
those  brain  damaged  cases  failing  designs 
lo.  11  and  12.  Each  of  these  required 
the  administration  of  Step  II.  These  de- 


ing  device.  However,  we  reali/.c  that  cer- 
tain limitations  may  have  been  placed 
on  the  test  by  such  aspects  as  the  type 
of  case  used,  recency  of  injury,  locus  of 
lesion,  etc.  To  determine  whether  the  dis- 
criminatory ability  of  the  item  could  be 
increased,  a  multiple  approach  was  made 


Table  19 

Number  and  per  cent  of  both  groups  failing  the  first  four  steps  of  the 
Golcistein-Scheerer  cube  test 


Failed  Step  One 

Required  Step  Two 

Required  Step  Three 

Failed  Step  Four 

Design 

|->rain 
Injured 

Controls 

Brain 
Injured 

Controls 

Brain 
Injured 

Controls 

Brain 
Injured 

Controls 

N 

% 

N 

% 

N 

% 

N 

% 

N 

% 

N 

% 

N 

% 

N 

% 

I 
2 
3 
4 
S 
6 

7 
8 

9 

10 
II 
12 

12 
4 
4 

5 
3 

5 

lO 

9 

9 

13 

14 

13 

27 
9 
9 

II 

7 
1 1 

23 
20 
20 

30 
32 
30 

9 
2 

I 

3 
I 

I 
I 

18 

4 
2 

6 
2 

2 
2 

3 
3 
4 

3 
2 

4 
10 
8 
6 
13 
14 
13 

25 

75 

100 

60 

67 

80 

100 

89 

67 

100 

100 

100 

I 

I 

I 

II 

33 
100 

2 
2 
2 
2 
2 

3 
7 
4 
3 
7 
8 
8 

17 
50 
50 
40 

67 
60 
70 
44 
33 
54 
57 
62 

I 

100 

2 
6 

3 
2 

5 
5 
5 

2 
2 
2 
2 
2 

5 
14 
7 
5 
1 1 
II 
1 1 

signs  particularly  emphasize  the  ability 
to  shift.  It  was  found  that  fourteen  of 
the  brain  injured  patients  tended  to  con- 
tinue to  construct  designs  1  o  and  1 1  in 
the  same  position  as  those  preceding,  and 
sixteen  patients  had  the  same  difficulty 
with  number  12.  In  each  case  eight  of 
them  were  unable  to  shift  their  mode  of 
attack  and  therefore  failed.  In  every  in- 
stance the  design  was  correctly  assembled 
but  was  not  placed  at  an  angle.  All  but 
three  that  failed  design  7  did  so  for  the 
above  reason— the  others  were  concerned 
with  the  necessity  for  a  white  background 
or  offered  a  single  block  as  the  solution. 
It  would  appear  that  in  general  failures 
due  to  inability  to  break  the  design  down 
and  reassemble  it  were  relatively  few  in 
number. 

These  quantitative  results  were  disap- 
pointing from  the  standpoint  of  a  screen- 


in  an  attempt  to  devise  an  objective  scor- 
ing system.  First  the  distribution  con- 
stants and  the  significance  of  mean  dif- 
ferences for  the  time  taken  to  complete 
each  design  were  computed.  This  pro- 
cedure was  applied  only  to  the  data  ob- 
tained from  those  successfully  complet- 
ing the  design  at  the  first  level.  The 
second  was  an  attempt  to  determine  the 
number  of  incorrect  mo\'es  that  were 
made  by  both  groups.  The  third  was  a 
study  of  the  order  or  sequence  employed 
in  placing  the  blocks.  That  is,  did  the 
patient  always  work  from  top  down  and 
left  to  right  or  exhibit  some  other  order 
that  was  regularly  employed?  Finally  the 
number  of  correct  first  block  placements 
were  determined.  None  of  these  methods 
uncovered  differences  that  were  signifi- 
cant. In  general  the  results  indicated  that 
if  the  patient  was  able  to  duplicate  the 
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design  it  was  done  with  normal  facility,  give  the  examiner  an  indication  of  the 

Qualitatively    the    behavior    observed  patient's  pre-injury  intelligence.  This  was 

was     as    described     by     Goldstein     and  found  to  be  necessary  because  a  few  of 

Scheerer   (9).   No  attempt  was  made   to  the  cases  tested,  who  were  of  low  intel- 

Table  20 
Intercorrelations  among  the  MAS  sub- tests 


Inf. 

Arith. 

Comp. 

Simil. 

Dig. 
Span 

Pic. 
Comp. 

Pic. 
Arr. 

Dig. 
Symb. 

Obj. 
Assem. 

Block 
Des. 

\^ocab. 

W-B 

Controls 
Brain  Inj. 

.84 
•83 

.60 
.62 

•57 

.72 

.72 
.72 

•23 
•43 

•55 
.6r 

.42 
•52 

.48 
•43 

•31 
•34 

•35 

44 

Inform. 

W-B 

Controls 
Brain  Inj. 

.60 

•63 
.60 

.67 
.62 
.72 

.68 
•73 
•74 

.48 
.14 
•47 

•47 
.60 

•52 

•38 

•45 
.41 

•56 

•58 
•37 

.22 

•34 
.26 

•49 

•54 

27 

Arith. 

W-B 

Controls 

Brain  Inj. 

•52 

•43 
.66 

.60 
.58 
.62 

•  44 
.29 

•56 

.40 

•45 
.41 

■37 
•32 
•54 

•43 
•44 
•52 

•23 
•38 
.40 

51 
SI 
54 

Com  pre. 

W-B 

Controls 
Brain  Inj. 

.72 

•51 
.64 

•44 
•43 
.42 

.46 

•45 
•45 

•39 
•31 
•49 

.48 
•53 
•45 

.29 

■33 
.26 

47 
37 
33 

Simil. 

W-B 

Controls 
Brain  Inj. 

•38 
.22 
.46 

.46 

•54 
.46 

•49 
•34 
.42 

■51 
•49 
.41 

•31 
.26 

•30 

54 
48 
42 

Dig. 
Span 

W-B 

Controls 

Brain  Inj. 

•30 
.29 

•34 

.26 
.26 
.46 

•54 
•03 
•23 

.16 
.04 
•23 

40 

33 
40 

Pic. 
Comp. 

W-B 

Controls 
Brain  Inj. 

•39 
.29 
.60 

.40 

•58 
•54 

.44 
•56 
•50 

57 
50 
56 

Pic. 
Arr. 

W-B 

Controls 

Brain  Inj. 

•44 
.28 

•63 

•27 
•42 
•47 

48 
65 
53 

Dig. 

Symb. 

W-B 

Controls 
Brain  Inj. 

•32 
•50 
•58 

54 
62 
62 

Obj. 
.'Xssemb. 

W-B 

Controls 

Brain  Inj. 

54 
58 
67 

classify  the  failures  according  to  the 
causes  listed  by  them.  It  was  felt  that 
such  subjective  categorization  made  the 
reliability  and  validity  of  the  indications 
given  of  questionable  value. 

V.  The  Stanjord-Bijiet  Vocabulary 
Test 

The  final  sub-test  is  the  Stanford-Rinct 
vocabidary  test  (31).  It  was  included  to 


ligence,  were  found  to  display  behavior 
and  obtained  scores  similar  to  those  of 
the  brain  injured  patients.  However,  we 
did  not  have  enough  of  these  cases  to 
present  any  definite  results.  It  is  possible 
that  some  characteristic  behavior  exists 
which  may  serve  to  differentiate  between 
these  two  entities.  Until  this  point  can 
be  resolved,  the  vocabulary  test  must  be 
relied   upon  for  this  purpose.  The  de- 
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ficicncics  of  such  technique  have  aheady 
been  discussed. 

In  most  instances  we  have  found  tliat 
it  is  possit)le  to  dispense  with  this  item. 
Previous  employment,  education  and 
otlicr  data  usually  supply  sufficient  in- 
loi  niation  legarding  the  patient's  approx- 
imate pre-injury  level.  However,  a  few 
cases  were  encountered  in  which  the 
necessary  data  coidd  not  be  obtained. 
Here  the  vocabulary  test  was  found  to  be 
helpfid. 

/■/.  Sub-Test  Interrelationship 

Quantitatively,  a  final  approach  was 
the  determination  of  the  degree  of  sub- 
test interrelationship  which  existed  for 
both  the  MAS  and  the  proposed  screen- 
ing test.  Table  20  presents  the  MAS  in- 
tercorrelation  coefficients.  Included  is  a 
AV^echsler-Bellevue  matrix  adapted  from 
that  given  by  Wechsler  (32).  There  are 
several  points  of  interest:  (1)  The  extent 
to  which  the  brain  damaged  and  control 
matrices  are  similar;  (2)  the  W-B  and 
MAS  coefficients  appear  to  agree  basi- 
cally; and  (3)  if  those  sub- tests  found  to 
be  diagnostic  are  considered,  a  very 
high  average  correlation  is  found  to  exist 
for  the  brain  injured  and  control  groups, 
the  brain  injured  mean  being  slightly, 
though  not  significantly,  higher. 

The  first  point  is  added  suggestive  evi- 
dence that  the  difference  between  the 
groups  is  purely  quantitative.  However, 
factor  analysis  technicpie  should  be  ap- 
plied to  this  data.  Results  so  obtained 
might  provide  evidence  as  to  whether 
any  functions  had  been  actually  lost  or 
dropped  out  of  the  pattern. 

The  second  point  adds  support  to  pre- 
vious findings  (1)  that  the  W-B  and  MAS 
are  interchangeable  instruments.  In  ad- 
dition W-B's  had  been  administered  to  a 
number  of  control  and  brain  injured  pa- 
tients   who    had    previously    taken    the 


MAS.  Ahhough  the  numbers  were  small, 
an  r^,,  f>f  -9^  ^vas  obtained.  Practice  effect, 
due  to  sub-test  simihu  ity,  and  long  stand- 
ing patient-examiner  relationship  were 
undoubtedly  reflected  in  the  coefficient. 
Larger  groups  must  be  used  l)efore  the 
above  findings  can  be  accepted  with  con- 
fidence. 

The  third  point  needs  little  discussion. 
None  of  the  r^yS  are  extremely  high,  but 
most  of  them  indicate  the  presence  of  a 
marked  relationship.  Every  clinician 
knows  that  the  sub-tests  of  a  diagnostic 
meastire  should  bear  as  little  relationship 
to  one  another  as  possible  without  sacri- 
ficing validity  and  reliability. 

From  this  standpoint,  it  will  also  be  of 
interest  to  consider  the  intercorrelations 
of  the  screening  device  sub-tests.  The  re- 
sults of  these  computations  are  shown  in 
Table  21.  None  of  the  intercorrelations 
for  the  control  group  are  significant  at 
the  1%  level,  except  that  for  the  two 
parts  of  the  Memory  test.  However,  a 
marked  correlation  between  the  scores 
obtained  by  brain  injured  patients  on 
certain  stib-tests  should  be  noted.  Specifi- 
cally, the  relationship  must  be  considered 
between  the  Patch  test  and  the  Trail 
Making  Test  and  the  relationship  be- 
tween parts  A  and  B  of  the  Trail  Making. 
It  will  be  noted  also  that  insignificant 
correlations  were  found  for  the  control 
patients  on  these  tests. 

It  has  been  pointed  out  earlier  in  the 
paper  that  a  highly  significant  difference 
was  found  between  the  mean  scores  for 
brain  injured  and  control  patients  on 
these  tests.  This  difference  was  explained 
primarily  on  the  basis  of  clinical  observa- 
tions of  the  difficulty  encountered  by  the 
brain  injured  patients  in  planning,  antic- 
ipation, and  coping  with  a  dual  rela- 
tionship seemingly  necessary  for  success- 
ful performance.  These  difficulties  were 
not  observed  to  any  marked  degree  in 
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the  control  groups.  Inasmuch  as  common 
difficulties  contribute  to  greatly  lowered 
scores  for  the  brain  injured  persons  on 
each  of  these  tests,  we  believe  that 
an  explanation  of  the  relationships  be- 
tween the  scores  is  offered.  It  may  be 
argued  that  this  is  not  a  satisfactory  ex- 
planation  inasmuch  as  it  might  just  as 


ing  to  consider  the  relationship  between 
these  scores  and  those  on  other  tests  con- 
sidered similar  in  nature.  The  correla- 
tions between  the  sub-tests  of  the  screen- 
ing device  and  the  sub-tests  of  the  MAS 
are  presented  in  Table  22.  It  will  be 
noted  that  in  general  the  correlations  are 
It     has     been     previously 


insignificant 


Table  21 
Intercorrelations  among  screening  measure  sub-tests 


Variable 

Groups 

Patch 
Test 

Total 
Trail 

Trail 
B 

Trail 
A 

Total 

Free 

Association 

Total  Memory 

Controls 

.16 

.12 

•  13 

.04 

Score 

Brain  Injured 

•17 

.07 

.21 

.08 

Patch  Test 

Controls 

.07 

.08 

-.06 

Brain  Injured 

•55 

•52 

•45 

Trail  Making  B 

Controls 

.26 

Brain  Injured 

.40 

Questions 

Controls 

.61 

Brain  Injured 

•75 

easily  be  expected  that  controls  have 
abilities  necessary  for  successful  perform- 
ance and  therefore  should  also  reveal  a 
rclationshijj.  Of  course  the  factor  of  in- 
dividtial  differences  undoubtedly  plays  a 
large  part  in  reducing  the  relationship  of 
these  scores  for  the  controls,  and  is  also 
probably  a  factor  in  the  accounting  for 
the  correlation  for  the  brain  injured  per- 
sons. We  can  only  assume  that  changes 
resulting  from  brain  injury  impair  per- 
formance in  the  respects  necessary  on 
these  tests  to  the  extent  that  low  scores 
on  each  show  less  variance. 

Inasmuch  as  significant  correlations 
found  between  the  Patch  test.  Trail  Mak- 
ing test  and  parts  A  and  B  of  this  test, 
have  been  explained  on  the  basis  of  im- 
pairment of  abilities  necessary  for  suc- 
cessful performance,  it  will  be  interest- 


pointed  out  that  Object  Assembly  and 
Block  Design  required  the  use  of  plan- 
ning and  anticipation.  The  Trail  Mak- 
ing and  Patch  tests,  also  requiring  these 
abilities,  show  significant  correlations 
with  the  MAS  sub-tests.  This  may  be  con- 
sidered suggestive  evidence  supporting 
our  explanation  that  the  relationship  is 
present  because  brain  injury  causes  im- 
pairment which  may  reduce  the  degree  of 
individual  differences  in  the  perform- 
ance of  certain  tests. 

Note  the  low  correlation  between  the 
Memory  test  and  the  Digit  Sj)an.  It  is 
ob\ious  that  they  are  not  measures  of 
the  same  function,  at  least  for  the  brain 
injured  patients.  It  has  been  stiggested 
(23)  and  supporting  evidence  has  been 
offered  (1)  that  the  Digit  Span  test  pri- 
marily measures  attention. 
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D.  CRITIQUE  OF  THE  SCREENING  TEST 

The  coniparati\e  results  of  each  sub- 
test have  been  considered.  The  question 
now  arises,  does  the  measine  meet  the 


patients  refused  to  allow  the  pieces  to 
be  put  away  until  every  design  had  been 
conijiletcd  to  their  satisfaction.  Three  of 
the  brain  injured  patients  asked  one  of 


Table  22 

Intercorrelations  among  the  screening  and  the  MAS 
sub-tests  for  brain  injured  patients 


Vocab. 

In- 
form. 

Arith. 

Gen. 
Comp. 

Simil. 

Dig. 
Span 

Pic. 
Comp. 

Pic. 
Arr. 

Dig. 
Symb. 

Obj. 

Assem. 

Block 
Des. 

Total  Free 

Association 

•13 

•34 

.29 

.08 

.28 

.16 

•23 

.i8 

.08 

.  22 

•15 

Questions 
Total  Trail 

.26 

.42 

.02 

.09 

.  21 

.04 

.24 

•17 

.09 

-.19 

.07 

Makini; 

•3S 

•45 

•45 

.  20 

•31 

.18 

.19 

.41 

•  30 

.68 

.62 

Patches 

.22 

.20 

.24 

-.07 

-  -OS 

.18 

■33 

•23 

•17 

•  42 

■47 

Key — For  an  N  of  44  an  rxy  of  .384  is  necessary  for  significance  at  the  one  per  cent  level. 

requirements  for  a  screening  test  that  the  examiners  if  extra  sets  of  the  test 
were  previously  established?  These  will  were  available  as  they  wanted  to  "try 
be  discussed  in  the  order  previously  them  on  their  friends", 
given.  In  the  experience  of  the  examiners, 
(i)  Test,  must  be  short.  The  average  rarely  has  a  test  proved  to  be  as  interest- 
time   taken   to   administer   the   test  was  ing.   Not  a  single  instance  of  rejection 


i 
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Table  23 
Screening  sub-test  validities 


^  Free         r\       ..•  Total  Trail  Trail  Total 

*^'"°"P^  Association  Q"^^''°"^     Memory  A  B  Trail 


Patches 


Total  Controls 

.62 

Normals 

.63 

Neurotics 

■S8 

•  51 

•  52 

•43 


.61 
.62 

.55 


■65 
.64 
•51 


•79 
.82 
.80 


.83 
•83 
■74 


.66 

■65 
.62 


25.6  minutes,  with  a  range  of  from  16  to 
38  minutes.  The  examiners  have  on  occa- 
sion given  10  tests  within  an  eight  hour 
period. 

(2)  Interesting.  Each  part  of  the  test 
seemed  to  catch  and  hold  the  interest  of 
the  patients.  Those  that  were  relatively 
uninteresting,  the  Trail  Making  and 
Goldstein-Scheerer  Cubes,  were  either 
preceded  by  a  test  of  intense  interest  or 
were  accomplished  so  rapidly  that  little 
opportunity  was  present  to  develop  any 
degree  of  dislike.  The  Patch  test  devel- 
oped such  enthusiasm  that  frequently  the 


occurred  nor  was  such  a  tendency  noted. 
Co-operation,  effort  and  motivation  were 
considered  optimum  in  every  case. 

(3)  Easy.  In  general  all  the  sub-tests 
but  Trail  Making  were  so  constructed 
that  the  brain  injured  patient  was  able 
to  exhibit  successful  performance  on  at 
least  the  initial  parts  of  the  test.  The 
method  of  dealing  with  failure  on  the 
Trail  Making  test  has  already  been  dis- 
cussed. With  the  exception  of  the  per- 
formance of  both  groups  on  the  fore- 
going test,  the  scores  were  well  distrib- 
uted. 
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(4)  Relatix'ely  unaffected  by  neurotic 
trends.  1  he  results  that  were  obtained 
suggested  that  the  sub-tests  used  were  not 
affected  by  neuroses.  However,  a  larger 
group  including  all  types  of  neurotic  dis- 
orders must  be  tested  to  assure  confidence 
in  this  respect. 

(5)  Sam()le  those  functions  that  seem 
to  suffer  771  ost  as  a  result  of  brain  injury. 
Not  every  field  of  possible  impairment 
resulting  from  brain  injury  has  yet  been 
explored.  However,  the  sub-tests  seem 
to  include  a  variety  of  those  functions 
that  appear  to  suffer  most  heavily. 

(6)  U ndersta7idability .  Over  half  of  the 
brain  injured  and  control  cases  were 
asked  what  they  considered  the  purpose 
of  each  sub-test  to  be.  Each  of  them  had 
some  definite  logical  idea  as  to  the  ra- 
tionale involved.  In  addition,  all  spon- 
taneous comments  were  recorded  and  ap- 
proximately thirty  per  cent  of  all  the 
brain  injured  patients  felt  that  this  was 
the  first  sensible  test  that  they  had  been 
required  to  take  and  none  of  them  were 
of  a  derogatory  nature.  This  may  be 
compared  to  the,  "I  don't  know  what 
good  this  test  is  going  to  do  me"  attitude 
that  some  of  the  MAS  and  W-B  sub-tests 
aroused. 

(7)  Have  a  miniTnum  dependence  on 
previously  learned  material.  The  Trail 
Making  test  is  the  only  one  that  would 
seem  to  have  any  relation  to  "old  learn- 
ing". Numbers  (the  sequence,  one,  two, 
three)  and  the  alphabet  have  been 
familiar  to  most  since  childhood.  This 
may  partially  account  for  the  correla- 
tions exhibited  between  Trail  Making 
and  Vocabulary,  Information  and  Arith- 
metic sub-tests  (Table  22).  In  relation  to 
this  point  it  should  be  noted  that  all 
other  sub-test  correlations  are  extremely 
low. 

(8)  Perfor77ia7ice  items  should  be  i'n- 
cluded.   Three  of   the   five  sub-tests   re- 


quire the  patient  to  work  with  his  hands 
and  the  others  recjuire  verbalization.  It 
is  felt  that  an  ample  sample  of  the  pa- 
tient's behavior  is  obtained  through  the 
administration  of  the  screening  test. 

(9)  Validity.  At  numerous  points 
throughout  the  paper  the  subject  of 
validity  has  been  considered.  It  is  admit- 
ted that  at  best  only  a  partial  validity 
can  be  determined  from  the  obtained 
data.  The  rbig  coefficients  that  were  com- 
puted are  shown  in  Table  23.  The  col- 
umn headed  "groups"  denotes  the  com- 
position of  the  total  groiq:)  used.  That  is, 
total  controls  plus  the  brain  injured 
comprised  the  first  category  used.  In 
every  instance  a  marked  relationship 
was  indicated  between  the  no  brain  in- 
jury category  and  high  scores  on  the  sub- 
tests. These  findings  may  be  compared 
with  the  results  given  in  Table  4.  The 
relationship  appears  to  be  most  marked 
for  the  "normals"  and  least  marked  for 
the  "neurotics".  Finally,  biserial  coeffi- 
cients were  determined  for  all  sub-tests 
with  a  group  composed  of  neurotics  and 
normals.  The  correlations  were  all  so 
small  that  they  could  not  be  considered 
significantly  greater  than  zero,  the  largest 
being  .21.  How  a  group  of  psychotics  or 
mental  deficients  would  compare  still  re- 
mains to  be  answered.  Until  these  and 
other  comparative  results  can  be  ob- 
tained the  true  validity  of  the  scale  will 
not  be  known. 

(10)  The  test  should  be  reliable.  The 
reader  is  referred  to  work  already  accom- 
plished (4). 

(11)  Directio7is  should  be  si/nple,  clear 
and  easily  understood.  Demonstration 
items,  samples,  and  carefully  worded  di- 
rections prevented  any  failures  that 
might  have  been  attributed  to  hazy  or 
unclear  explanations.  Very  few  of  the 
patients  in  either  group  asked  for  added 
information  and  none  of  the  failures  re- 
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fleeted  the  lack  of  understandiri"  of  \\liai 
was  required. 

(12)  .///  perjonnance  tests  should  be  of 
siuli  nature  that  they  can  be  accom- 
plished by  gross  muscular  mox>ements.  It 
has  liccn  dcterminetl  that  with  only  one 
fimctioning  hand  every  test  can  be  ac- 
complished within  the  range  of  normal 
performance.  Of  all  the  sub-tests  the 
Trail  Making  oflered  the  greatest  amount 
of  difficulty  to  the  patient  who  had  the 
use  of  only  one  hand.  This  difficulty 
could  be  overcome  by  fastening  two 
copies  of  the  test,  one  with  the  sample 
and  the  other  with  the  test  side  up,  to 
the  desk  top  with  scotch  tape.  The  loss 
of  the  use  of  the  preferred  hand  is  an 
additional  aspect  that  must  be  consid- 
ered. Only  t\\'o  such  cases  were  found  and 
•in  each  instance  the  performance  fell 
within  the  normal  range. 

In  addition  to  these  twelve  points  is 
the  consideration  that  in  its  present  form 


the  test  is  not  suitable  for  use  unless  the 
examiner  has  had  considerable  clinical 
experience.  There  has  been  no  attempt 
made  to  obtain  a  final  or  total  score 
which  might  be  fitted  into  such  cate- 
gories as:  Normal,  slightly  less  normal, 
relatively  suspicious,  etc.  This  procedme 
appears  to  be  irccjuently  misleading.  The 
screening  test  has  been  designed  so  that 
both  the  quantitative  and  qualitative  as- 
pects can  be  evaluated.  In  short,  it  is 
aimed  at  sampling  behavior  and  the 
total  performance  exhibited  by  the  brain 
damaged  patient.  Such  considerations 
are  difficvdt  to  reduce  to  a  numerical 
score  which  can  be  readily  categorized. 
Finally,  the  groups  used  in  this  study 
were  all  limited  numerically.  Further 
work  must  be  carried  out  with  this  test 
or  others  of  a  similar  nature.  Norms 
based  on  groups  as  small  as  were  con- 
sidered can  often  be  misleading  despite 
the  most  exacting  statistical  analysis. 


VI.  Summary  and  Conclusions 


1.  Four  tests  previously  used  to  deter- 
mine the  presence  of  brain  injury  were 
considered  in  terms  of  their  comparative 
advantages,  disadvantages,  and  rational. 
These  tests  were  the  MAS,  Shipley,  Hinit 
and  Rorschach.  It  is  suggested  that  the 
Rorschach  is  the  most  useful  for  this 
purpose.  The  value  of  the  measure  arises 
from  its  ability  to  tap  many  aspects  of 
the  individual  personality  untouched  by 
the  other  three.  Inasmuch  as  the  under- 
standing of  the  brain  injured  patient 
does  not  lie  alone  in  an  inventory  of  in- 
tellectual functions,  the  wider  scope  of 
this  test  becomes  doubly  important, 

2.  The  need  for  a  screening  device  was 
stressed.  Regardless  of  the  ultimate  value 
of  all  of  the  above  measures  each  had 
certain  disadvantages  as  a  preliminary 
or  screening  test. 

3.  A  five  sub-test  screening  measure 
was  proposed.  It  consisted  of  the  Mem- 
ory, Trail  Making  and  Patch  sub-tests 
from  the  AIT,  the  Goldstein-Scheerer 
Cube  test,  and  the  Stanford-Binet  vocab- 


idary.  These  were  chosen  as  they  seemed 
to  test  the  following  functions;  (i)  recent 
memory,  (2)  abstraction  ability  (analysis 
and  synthesis),  (3)  ability  to  deal  effec- 
tively with  a  dual  relationship,  (4)  ability 
to  plan  and  anticipate,  (5)  perseverative 
trends,  and  (6)  the  ability  to  shift.  Tests 
measuring  specific  functions  were  se- 
lected because  previous  studies  (1,2)  had 
suggested  that  they  were  retarded  by  the 
presence  of  post-traumatic  brain  injury. 

4.  The  administration  of  the  screening 
test  to  a  group  of  definite  brain  injured 
and  control  patients  (normals  and  neu- 
rotics) indicated  definite  quantitative 
and  qualitative  variance.  Whether  these 
obtained  differences  are  to  be  considered 
characteristic  of  only  post-traumatic 
brain  injury  could  not  be  determined. 
Further  validation  either  with  this  test 
or  measures  of  a  similar  nature,  using 
larger  groups  and  including  other  per- 
sonality variants,  must  be  accomplished 
before  this  point  can  be  resolved  with 
any  assurance. 
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